-- Logs begin at Mon 2022-05-09 17:26:56 UTC, end at Mon 2022-05-09 18:57:34 UTC. -- May 09 18:22:35.957114 dv-cinder-835881-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 18:22:35.965371 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 18:22:35 2022] *** May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: nodename: dv-cinder-835881-8-iscsi May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: machine: x86_64 May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: clock source: unix May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: pcre jit disabled May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: detected number of CPU cores: 4 May 09 18:22:35.967360 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: current working directory: / May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: detected binary path: /usr/bin/uwsgi-core May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: your processes number limit is 47680 May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: your memory page size is 4096 bytes May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: detected max file descriptor number: 2048 May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: lock engine: pthread robust mutexes May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: thunder lock: enabled May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 18:22:35.968025 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 18:22:36.013015 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: Python main interpreter initialized at 0x55557cac49c0 May 09 18:22:36.013015 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: python threads support enabled May 09 18:22:36.013015 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: your server socket listen backlog is limited to 100 connections May 09 18:22:36.013015 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: your mercy for graceful operations on workers is 90 seconds May 09 18:22:36.013453 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: mapped 403077 bytes (393 KB) for 2 cores May 09 18:22:36.013531 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: *** Operational MODE: preforking *** May 09 18:22:36.013763 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: *** uWSGI is running in multiple interpreter mode *** May 09 18:22:36.013763 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: spawned uWSGI master process (pid: 102567) May 09 18:22:36.014021 dv-cinder-835881-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 18:22:36.014585 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: spawned uWSGI worker 1 (pid: 102568, cores: 1) May 09 18:22:36.015626 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: spawned uWSGI worker 2 (pid: 102569, cores: 1) May 09 18:22:36.015626 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 18:22:37.211473 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:22:37.212143 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:22:37.940343 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:22:37.940343 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: from cryptography.utils import int_from_bytes May 09 18:22:37.940644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:22:37.940644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: from cryptography.utils import int_from_bytes May 09 18:22:37.940644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:22:37.940644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: from cryptography.utils import int_from_bytes May 09 18:22:37.940894 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:22:37.940894 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: from cryptography.utils import int_from_bytes May 09 18:22:40.579031 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:22:40.579696 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:22:40.579798 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:22:40.580196 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:22:40.580451 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:22:40.580836 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.581168 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.581487 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.581806 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.581956 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:22:40.582332 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:22:40.582412 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.582412 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.582616 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:22:40.582720 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.582994 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:22:40.583126 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.583243 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:22:40.583339 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.583586 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.583730 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.583898 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584074 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584242 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-8-iscsi {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584392 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584547 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584693 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584863 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.584997 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585157 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585251 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585465 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585556 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585763 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.585866 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586079 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586169 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586340 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586439 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586651 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.586856 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587263 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-8-iscsi {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587263 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587501 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587608 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587724 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587843 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.587996 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.588179 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.588370 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.588562 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.588800 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.588998 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.589210 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.589429 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.589631 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.589631 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.590014 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.590237 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.590435 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.590629 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.590845 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.591062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-8-iscsi {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.591262 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.591471 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.591678 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.591874 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592096 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592230 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592401 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592401 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592783 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.592986 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593185 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593320 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593445 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593569 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593709 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593709 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.593960 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-8-iscsi {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594096 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594228 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594351 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594482 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594606 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594730 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594872 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.594999 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595124 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595248 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595379 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595513 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595647 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595771 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.595906 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596061 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596189 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596327 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596451 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596574 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596705 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.596960 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597092 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597231 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597365 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597489 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597612 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597744 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.597876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598009 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598009 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598251 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598375 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598508 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598633 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598764 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.598897 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599022 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599154 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599286 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599420 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599551 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599682 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599817 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.599970 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600110 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600243 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600370 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600493 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600617 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600752 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.600885 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601010 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601133 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601312 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601462 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601595 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601719 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.601907 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602054 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602178 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602311 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602502 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602653 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602821 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.602993 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603109 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603236 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603402 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603520 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603704 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.603833 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604055 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604187 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604328 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604481 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604665 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604790 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.604984 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605125 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605262 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605387 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605712 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605837 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.605970 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606094 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606217 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606340 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606567 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606700 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.606887 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607018 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607149 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607280 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607412 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607552 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607685 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607818 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.607998 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608143 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608305 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608449 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608629 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608769 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.608900 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609036 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609191 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609331 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609505 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609643 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609799 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.609931 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610107 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610250 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610374 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610508 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610695 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.610826 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611006 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611154 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611278 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611400 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611565 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611706 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.611840 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612070 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612198 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612321 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612477 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612608 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612800 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.612931 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613086 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613215 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613391 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613530 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613663 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613788 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.613975 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614119 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614244 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614366 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614565 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614705 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.614991 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615305 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615478 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615597 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615779 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.615906 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616106 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616239 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616375 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616501 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616710 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.616871 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617001 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617180 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617321 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617477 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617608 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617846 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.617991 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618124 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618263 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618526 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618661 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618798 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.618930 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619054 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619177 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619302 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619425 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619588 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619715 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.619886 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620056 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620216 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620352 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620512 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620638 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620813 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.620939 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621115 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621241 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621447 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621574 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621748 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.621882 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622049 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622183 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622354 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622491 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622656 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.622782 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.622953 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.623079 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.623268 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.623403 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.623586 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.623713 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.623895 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.624058 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.624224 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.624360 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.624526 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.624653 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.624839 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:22:40.624965 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625175 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625311 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625498 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625626 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625810 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.625947 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626122 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626249 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626432 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626566 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626746 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.626873 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627063 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627190 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627374 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627500 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627686 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.627812 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628009 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628136 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628333 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628555 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628702 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628826 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.628959 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629086 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629311 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629442 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629576 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629700 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629835 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.629959 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630168 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630303 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630486 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630613 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630801 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.630929 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631109 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631243 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631423 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631560 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631736 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.631862 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632084 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632212 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632401 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632542 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.632868 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633066 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633199 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633375 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633511 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633688 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633813 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.633995 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634124 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634304 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634612 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634740 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.634920 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635048 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635227 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635356 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635556 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635682 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.635865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636046 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636186 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636316 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636497 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636625 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636827 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.636961 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637169 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637296 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637476 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637601 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637784 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.637911 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638084 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638212 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638384 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638519 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638686 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638822 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.638993 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639128 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639292 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639435 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639609 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639744 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.639918 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640083 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640251 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640377 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640556 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640711 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640860 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.640988 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641163 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641292 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641469 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641598 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641770 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.641904 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642071 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642204 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642379 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642517 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642686 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642822 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.642989 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643117 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643311 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643440 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643620 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643741 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.643922 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644090 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644255 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644369 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644555 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644668 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644856 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.644987 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645164 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645291 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645470 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645598 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645775 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.645894 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646082 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646197 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646388 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646504 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646704 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.646829 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647007 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647119 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647313 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647427 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647627 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647767 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.647937 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648103 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648266 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648393 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648573 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648717 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.648884 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649021 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649191 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649317 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649492 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649614 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649797 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.649926 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650096 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650224 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650396 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650524 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650694 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650831 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.650998 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651133 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651300 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651428 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651599 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651727 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.651898 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652069 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652210 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652343 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652544 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652672 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.652863 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653003 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653165 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653292 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653461 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653587 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653759 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.653966 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654093 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654216 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654354 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654633 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.654933 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655061 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655252 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655380 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655560 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655697 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.655861 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656012 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656187 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656316 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656487 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656612 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656823 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.656935 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657123 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657244 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657427 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657541 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657735 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.657850 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658051 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658174 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658357 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658472 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658672 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658786 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.658978 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659093 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659285 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659399 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659587 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659713 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.659894 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660068 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660209 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660333 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660520 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660648 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660840 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.660974 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661157 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661285 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661593 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661781 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.661920 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662088 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662214 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662398 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662531 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662701 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.662836 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663005 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663138 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663311 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663446 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663618 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663760 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.663937 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664084 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664270 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664399 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664583 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664721 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.664889 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665016 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665193 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665318 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665498 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665624 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665802 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.665951 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666103 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666215 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666414 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666537 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666722 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.666862 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667038 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667213 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667352 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667488 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667622 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667746 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.667936 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668252 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668402 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668537 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668663 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668786 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.668911 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669049 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669231 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669363 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669552 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669686 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669859 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.669983 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670166 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670471 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670586 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670777 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.670904 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671074 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671194 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671380 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671492 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671682 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.671804 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.672001 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.672134 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.672744 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.672855 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.672976 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673104 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673228 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673351 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673519 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673646 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673819 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.673947 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674130 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674266 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674431 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674556 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674730 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.674867 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675030 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675156 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675369 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675488 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675637 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675800 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.675928 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676103 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676251 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676399 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676583 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676709 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.676887 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677015 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677187 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677322 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677499 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677625 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677805 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.677931 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678106 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678247 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678406 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678532 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678706 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.678835 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679008 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679145 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679324 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679453 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679629 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679754 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.679931 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680083 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680256 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680372 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680562 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680676 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680867 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.680982 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.681174 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.681295 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.681480 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.681600 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.681881 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682064 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682174 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682399 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682508 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682707 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682818 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.682957 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.683072 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.683270 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.683394 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.683599 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.683906 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684093 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684267 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684395 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684597 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684726 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684850 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.684974 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685151 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685279 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685458 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685586 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685772 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.685899 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686129 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686344 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686486 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686676 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686813 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.686991 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687119 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687309 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687447 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687630 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687759 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.687937 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688110 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688244 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688370 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688551 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688679 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688853 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.688982 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689162 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689299 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689464 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689602 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689766 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.689902 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690068 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690204 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690372 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690507 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690674 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690801 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.690973 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691099 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691272 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691399 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691577 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691711 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.691876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692054 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692214 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692341 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692513 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692640 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692811 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.692940 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693111 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693237 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693410 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693535 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693719 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.693856 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694022 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694150 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694342 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694470 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694649 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694787 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.694951 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695077 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695250 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695377 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695550 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695687 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.695883 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696034 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696209 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696337 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696510 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696651 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696817 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.696946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697122 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697250 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697420 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697557 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697728 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.697856 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698031 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698159 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698338 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698640 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698767 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.698936 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699069 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699240 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699417 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699616 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699742 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.699919 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700068 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700245 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700380 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700544 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700679 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700844 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.700982 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701147 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701261 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701449 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701586 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701746 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.701869 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702044 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702173 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702340 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702651 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702799 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.702949 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703075 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703246 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703374 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703544 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703679 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.703844 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704007 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704151 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704278 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704457 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704618 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704742 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.704865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706072 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706226 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706366 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706502 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706502 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706741 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706741 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706975 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.706975 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707304 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707430 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707554 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707554 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707787 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.707787 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708088 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708088 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708340 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708599 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708724 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708850 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.708973 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709098 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709221 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709355 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709482 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709616 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709749 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709874 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.709874 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710117 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710242 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710366 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710501 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710627 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710750 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.710884 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711009 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711145 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711272 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711397 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711539 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711664 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711788 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.711912 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712065 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712190 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712333 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712460 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712460 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712697 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712821 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.712952 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713086 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713219 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713351 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713484 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713618 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713734 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713865 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.713989 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714112 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714234 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714357 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714489 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714694 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.714824 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715025 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715154 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715370 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715506 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715673 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.715808 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716000 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716130 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716300 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716442 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716586 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716704 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.716899 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717028 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717206 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717505 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717630 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717816 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.717944 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718122 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718265 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718430 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718574 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718767 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.718895 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719029 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719153 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719312 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719447 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719615 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719741 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.719919 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720063 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720247 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720360 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720553 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720669 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720859 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.720984 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721158 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721272 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721463 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721583 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721769 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.721900 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722071 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722199 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722377 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722505 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722682 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722802 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.722979 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723093 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723286 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723408 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723589 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723701 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.723889 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724037 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724219 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724346 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724519 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724633 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724824 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.724936 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725123 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725247 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725420 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725563 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.725855 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726047 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726172 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726347 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726470 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726651 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726779 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.726952 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.727071 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.727258 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.727381 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.727561 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.727676 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728312 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728461 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728461 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728700 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728838 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.728964 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729098 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729222 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729349 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729480 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729616 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729748 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729873 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.729996 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730119 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730242 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730365 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730498 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730772 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.730900 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731077 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731204 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731384 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731530 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731700 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.731836 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732022 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732150 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732329 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732473 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732638 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732766 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.732958 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733086 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733258 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733387 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733559 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733720 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.733849 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734031 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734289 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734426 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734551 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734675 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734798 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.734951 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735149 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735278 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735460 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735587 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735761 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.735888 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736169 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736297 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736488 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736623 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736793 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.736946 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737085 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737209 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737396 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737532 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737698 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.737828 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738018 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738142 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738334 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738468 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738642 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738772 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.738959 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739095 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739306 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739431 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739617 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739745 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.739931 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740096 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740256 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740392 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740577 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740705 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.740898 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741034 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741207 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741335 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741524 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741649 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741826 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.741955 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742131 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742259 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742452 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742580 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742754 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.742890 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743060 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743188 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743367 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743496 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743672 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743800 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.743990 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744123 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744294 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744422 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744628 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744766 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.744893 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745026 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745206 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745347 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745515 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745643 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745834 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.745969 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746138 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746298 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746466 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746600 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746767 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.746901 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747079 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747215 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747379 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747506 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747682 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.747809 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748122 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748270 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748388 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748511 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748635 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748759 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.748916 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749046 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749235 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749371 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749543 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749670 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749846 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.749974 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750147 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750274 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750448 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750576 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750858 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.750999 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751135 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751260 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751387 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751511 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751700 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.751829 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752019 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752159 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752330 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752468 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752632 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752761 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.752935 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753063 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753237 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753374 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753545 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753681 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753845 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.753974 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754146 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754285 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754450 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754594 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754754 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.754881 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755061 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755199 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755365 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755507 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755665 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755794 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.755975 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756105 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756283 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756411 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756582 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756709 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.756880 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757008 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757199 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757336 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757500 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757629 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757818 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.757947 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758125 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758266 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758426 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758554 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758727 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.758863 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759025 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759154 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759349 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759484 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759652 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759790 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.759979 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760108 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760296 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760437 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760614 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760742 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.760924 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761061 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761231 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761367 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761535 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761663 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.761908 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762047 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762231 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762369 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762549 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762678 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.762865 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763119 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763267 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763449 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763585 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763764 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.763893 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764098 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764412 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764539 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764719 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.764846 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765030 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765172 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765340 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765581 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765710 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.765908 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766039 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766220 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766357 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766530 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766658 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766841 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.766980 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767152 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767281 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767463 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767591 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767774 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.767916 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768126 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768252 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768406 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768532 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768714 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.768842 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769039 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769168 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769360 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769508 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769654 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.769816 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770002 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770194 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770391 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770614 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770801 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.770934 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771069 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771196 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771323 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771457 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771584 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771713 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771840 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.771989 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.772162 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.772354 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.772471 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.772680 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.772796 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773043 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773253 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773366 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773474 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773673 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773786 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.773987 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774112 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774297 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774421 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774606 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774746 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.774915 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.775053 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.775225 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.775369 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.775563 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.775839 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776058 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776188 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776312 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776499 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776636 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776811 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.776954 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.777122 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.777258 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.777459 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.777590 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.777781 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778009 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778138 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778325 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778453 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778658 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778788 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.778980 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779117 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779288 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779416 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779589 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779732 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.779905 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780066 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780239 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780376 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780541 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780678 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780843 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.780971 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.781152 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.781281 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.781462 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.781679 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.781818 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782028 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782164 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782341 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782470 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782659 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.782977 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783105 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783285 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783427 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783588 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783813 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.783967 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784186 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784314 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784504 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784634 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784816 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.784937 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785124 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785339 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785489 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785625 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785752 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.785876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786006 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786304 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786440 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786605 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786741 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.786923 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787066 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787225 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787363 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787527 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787663 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787835 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.787996 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788167 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788298 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788467 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788591 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788778 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.788903 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789080 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789196 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789379 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789493 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789677 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789792 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.789977 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790092 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790278 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790400 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790576 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790703 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790881 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.790996 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791182 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791295 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791487 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791603 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791784 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.791898 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792112 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792244 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792424 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792555 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792726 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.792855 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793078 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793212 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793387 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793516 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793697 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793825 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.793999 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794306 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794444 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794613 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794740 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.794920 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795058 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795258 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795385 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795565 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795701 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.795879 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796138 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796278 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796469 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796599 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796787 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.796916 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.797114 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.797241 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.797749 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.797879 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798054 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798192 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798357 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798606 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798737 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.798936 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799074 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799256 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799393 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799573 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799702 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.799881 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800087 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800207 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800323 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800536 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800664 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800813 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.800937 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801122 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801236 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801428 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801552 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801734 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.801859 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802039 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802152 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802507 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802643 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802775 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.802966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803078 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803186 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803311 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803434 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803568 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803694 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.803851 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804014 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804196 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804325 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804507 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804669 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804795 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.804934 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805102 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805230 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805406 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805535 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805711 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.805839 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806022 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806164 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806342 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806470 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806656 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806784 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.806957 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807093 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807261 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807388 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807567 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807695 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.807877 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808042 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808220 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808348 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808560 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808717 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.808901 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809040 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809209 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809337 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809552 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809679 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.809870 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810000 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810178 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810307 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810502 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810640 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810831 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.810958 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811151 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811280 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811470 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811583 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811773 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.811936 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812145 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812256 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812392 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812523 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812738 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.812866 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813003 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813119 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813310 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813440 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813610 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813734 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.813910 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814042 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814216 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814361 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814518 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814655 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814820 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.814949 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815120 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815257 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815419 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815547 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815723 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.815852 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816044 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816175 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816345 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816474 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816780 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.816943 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817080 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817242 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817369 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817539 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817674 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817841 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.817977 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818139 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818272 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818436 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818573 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818732 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.818851 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819029 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819163 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819325 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819621 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819749 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.819926 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820090 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820249 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820400 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820549 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820686 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820847 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.820976 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821147 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821284 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821444 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821573 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821771 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.821907 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822089 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822216 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822404 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822533 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822726 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.822850 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823032 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823158 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823339 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823472 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823642 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823769 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.823962 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824078 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824287 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824444 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824639 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824766 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.824946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825076 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825278 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825412 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825585 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825720 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.825891 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826028 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826197 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826326 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826506 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826643 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826812 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.826942 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827119 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827247 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827422 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827558 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827747 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.827875 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828070 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828206 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828372 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828501 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828685 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828812 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.828991 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829120 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829297 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829426 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829602 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829729 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.829914 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830041 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830224 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830351 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830530 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830658 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.830844 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831056 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831192 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831318 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831451 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831577 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831756 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.831898 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.832100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.832245 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.832442 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.832641 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.832846 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.833074 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.833270 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.833462 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.833462 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.833838 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.834055 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:22:40.834258 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.834258 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.834617 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.834617 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.835024 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.835239 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.835496 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:22:40.835736 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102569) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:22:40.861858 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:40.863403 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102569) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:40.926124 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.context [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f91d991-cb29-42d8-aa28-79062e35eafc(cell1) {{(pid=102568) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:22:40.930527 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:22:40.930794 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.context [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f91d991-cb29-42d8-aa28-79062e35eafc(cell1) {{(pid=102569) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:22:40.932142 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:22:40.932949 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:22:40.934975 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:22:40.935281 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_concurrency.lockutils [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102569) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:22:40.936897 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_concurrency.lockutils [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102569) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:22:40.937691 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_concurrency.lockutils [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102569) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:22:40.939658 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_concurrency.lockutils [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102569) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:22:40.946533 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:40.949473 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:40.954761 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102569) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:40.957636 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102569) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:41.120634 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:41.126332 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102569) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:22:41.470866 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:22:41.471054 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: WARNING keystonemiddleware.auth_token [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:22:41.477563 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:22:41.480222 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: WARNING keystonemiddleware.auth_token [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:22:41.818729 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:22:41.823622 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: WARNING keystonemiddleware.auth_token [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:22:41.824959 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:22:41.830900 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: WARNING keystonemiddleware.auth_token [None req-c7c3ad99-73d8-411b-93b8-8f15c7c2644e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:22:41.831204 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55557cac49c0 pid: 102568 (default app) May 09 18:22:41.833358 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:41.834546 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001792 May 09 18:22:41.834946 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Mon May 9 18:22:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:41.836040 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55557cac49c0 pid: 102569 (default app) May 09 18:24:02.269181 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:02.270990 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002255 May 09 18:24:02.271585 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:02.736770 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-a393b5df-8810-4929-9c52-6415011dd964 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:02.766842 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-a393b5df-8810-4929-9c52-6415011dd964 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487542 May 09 18:24:02.767335 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1291 bytes} [Mon May 9 18:24:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:05.096202 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:05.097415 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-207af675-bff6-4b39-a6e3-d366c30969ee None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 May 09 18:24:05.098124 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:05.171930 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-87ff7fd2-801e-48a9-9891-54aa0cf6a95b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "swap": 0, "ram": 256}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:05.190592 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:24:05.190592 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: warnings.warn(msg) May 09 18:24:05.226790 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-87ff7fd2-801e-48a9-9891-54aa0cf6a95b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.122399 May 09 18:24:05.227711 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:05.456457 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f3afcabe-ad6d-4fcb-89f8-bb65dc6aa72c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:05.458927 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:24:05.458927 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:24:05.512398 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f3afcabe-ad6d-4fcb-89f8-bb65dc6aa72c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273127 May 09 18:24:05.513353 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1335 bytes} [Mon May 9 18:24:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:07.883235 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-87ff7fd2-801e-48a9-9891-54aa0cf6a95b admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:07.884564 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-87ff7fd2-801e-48a9-9891-54aa0cf6a95b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 May 09 18:24:07.885074 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:08.025249 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1c31f338-fc91-44a3-9c6d-3960e4958777 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "swap": 0, "id": "d1", "vcpus": 1}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:08.043529 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:24:08.043529 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:24:08.062915 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-1c31f338-fc91-44a3-9c6d-3960e4958777 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170286 May 09 18:24:08.063418 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:24:08.079259 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-4e59c2ea-f7e8-45de-95f4-82506448629f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:08.081676 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:24:08.081676 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: warnings.warn(msg) May 09 18:24:08.122907 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-4e59c2ea-f7e8-45de-95f4-82506448629f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050326 May 09 18:24:08.123531 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1335 bytes} [Mon May 9 18:24:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:10.483628 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1c31f338-fc91-44a3-9c6d-3960e4958777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:10.485279 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-1c31f338-fc91-44a3-9c6d-3960e4958777 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 May 09 18:24:10.486108 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:10.569402 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-3d18d32d-7bb0-4b6b-9028-441c8e90384f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "disk": 10, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:10.590961 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-3d18d32d-7bb0-4b6b-9028-441c8e90384f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098578 May 09 18:24:10.591535 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:24:10.604311 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-38dacdf6-628a-4af9-a39f-5d229f3352e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:10.633208 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-38dacdf6-628a-4af9-a39f-5d229f3352e4 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033264 May 09 18:24:10.634306 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1335 bytes} [Mon May 9 18:24:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:13.046374 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-3d18d32d-7bb0-4b6b-9028-441c8e90384f admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:13.047429 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-3d18d32d-7bb0-4b6b-9028-441c8e90384f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 09 18:24:13.047835 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:13.114097 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f5807ccc-d07a-4479-aebc-259b953115a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:13.136521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f5807ccc-d07a-4479-aebc-259b953115a4 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081900 May 09 18:24:13.137047 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:13.149624 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-3178f8e5-b5ab-40a9-ae6c-c853785c6b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:13.174893 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-3178f8e5-b5ab-40a9-ae6c-c853785c6b66 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029031 May 09 18:24:13.175572 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1335 bytes} [Mon May 9 18:24:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:15.571494 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f5807ccc-d07a-4479-aebc-259b953115a4 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:15.573166 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f5807ccc-d07a-4479-aebc-259b953115a4 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 May 09 18:24:15.575211 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:15.653416 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "ram": 4096, "swap": 0}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:15.675238 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093982 May 09 18:24:15.676329 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:15.690775 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-0de11391-c799-43ff-a6f4-54d2af08274b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:15.720826 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-0de11391-c799-43ff-a6f4-54d2af08274b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034589 May 09 18:24:15.721486 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1335 bytes} [Mon May 9 18:24:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:24:18.040283 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:18.042161 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002346 May 09 18:24:18.042590 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:18.107530 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-fa055209-f111-4530-8173-f00e43a9d600 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:18.134891 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-fa055209-f111-4530-8173-f00e43a9d600 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084851 May 09 18:24:18.135432 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1291 bytes} [Mon May 9 18:24:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:20.574608 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:20.575653 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-903bc2e0-7f47-4b73-8319-9bd4f0494f5d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 May 09 18:24:20.576146 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:20.649437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a13facd3-e63a-44b6-97cc-893d8e3904b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:20.676158 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a13facd3-e63a-44b6-97cc-893d8e3904b7 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093280 May 09 18:24:20.676756 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:20.689486 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-ea2dead8-d018-4ee5-9789-d48cc202ba48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:20.723547 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-ea2dead8-d018-4ee5-9789-d48cc202ba48 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037871 May 09 18:24:20.724679 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1332 bytes} [Mon May 9 18:24:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:23.462645 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a13facd3-e63a-44b6-97cc-893d8e3904b7 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:23.463637 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a13facd3-e63a-44b6-97cc-893d8e3904b7 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 09 18:24:23.464076 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:23.547363 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-b39b62d5-a053-4acf-92e4-ad219f5f7917 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:23.568426 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-b39b62d5-a053-4acf-92e4-ad219f5f7917 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095368 May 09 18:24:23.569080 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:23.583095 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-d5542a88-e743-4f5d-8bbd-f4b753ac02ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:23.610380 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-d5542a88-e743-4f5d-8bbd-f4b753ac02ac admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031603 May 09 18:24:23.611042 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1332 bytes} [Mon May 9 18:24:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:25.929604 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-b39b62d5-a053-4acf-92e4-ad219f5f7917 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:25.930748 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-b39b62d5-a053-4acf-92e4-ad219f5f7917 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 May 09 18:24:25.931199 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:25.998122 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-71fee6ee-8444-453c-b7fc-61e1d1af855c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "vcpus": 2, "swap": 0}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:26.018341 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-71fee6ee-8444-453c-b7fc-61e1d1af855c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080589 May 09 18:24:26.018906 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:26.032242 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-58892cf3-9056-4581-a247-37b0501858d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:26.056141 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-58892cf3-9056-4581-a247-37b0501858d9 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028718 May 09 18:24:26.057092 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1332 bytes} [Mon May 9 18:24:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:28.320084 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-71fee6ee-8444-453c-b7fc-61e1d1af855c admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:28.321091 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-71fee6ee-8444-453c-b7fc-61e1d1af855c admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 09 18:24:28.321524 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:28.385536 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-5bb245bb-7589-4fe1-97e2-b99315e8ae17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:28.412701 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-5bb245bb-7589-4fe1-97e2-b99315e8ae17 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084856 May 09 18:24:28.413253 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:28.425857 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-053cdd02-59a8-469a-9968-38c4dca02610 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:28.457835 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-053cdd02-59a8-469a-9968-38c4dca02610 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035464 May 09 18:24:28.458870 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1332 bytes} [Mon May 9 18:24:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:30.781731 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-5bb245bb-7589-4fe1-97e2-b99315e8ae17 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:30.783398 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-5bb245bb-7589-4fe1-97e2-b99315e8ae17 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 May 09 18:24:30.783985 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:30.849448 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:30.871600 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081655 May 09 18:24:30.872915 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1282 bytes} [Mon May 9 18:24:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:24:30.885205 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-790f9e33-14d9-4067-8a89-aeefe445dc13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:24:30.927981 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-790f9e33-14d9-4067-8a89-aeefe445dc13 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046464 May 09 18:24:30.928922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1332 bytes} [Mon May 9 18:24:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:55.110784 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:55.112704 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 May 09 18:24:55.113367 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:55.187607 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-4d096021-ac4a-4690-9fc6-c3f33af551fb admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:55.205807 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-4d096021-ac4a-4690-9fc6-c3f33af551fb admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.084658 May 09 18:24:55.206356 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1291 bytes} [Mon May 9 18:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:56.252799 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:56.253850 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a29c8712-af3a-4e31-9209-26a1c7a34066 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 09 18:24:56.254257 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:56.476117 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-b3f9b038-aef9-46fc-962f-c7f6fcf047cf admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:56.482865 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.wsgi [None req-b3f9b038-aef9-46fc-962f-c7f6fcf047cf admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-b3f9b038-aef9-46fc-962f-c7f6fcf047cf admin admin] Request method failure captured: May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept: application/json May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept-Encoding: gzip, deflate May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Connection: keep-alive May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Content-Length: 0 May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Host: 10.222.0.35 May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-Api-Version: compute 2.90 May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-System-Scope: None May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: User-Agent: python-novaclient May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Auth-Token: gAAAAABieVx4Mm_APjTrUyJewSBxaYf3pP3z5TXwkz6dt70i4cpcC_sSownvv1Slhuu2JvzZsu5Kd6M42_cTss8HDLLRw63FW6pfJujrmr23O1UpBRCyGwK99ECGWsY590KYrVLbZPfQPzTIwjLm_n9YG3IL_1NbYrxnThOeEpjtg9vWriXPJCg May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Id: None May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Name: None May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Identity-Status: Confirmed May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Is-Admin-Project: True May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Id: default May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Name: Default May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Name: admin May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Role: member,reader,admin May 09 18:24:56.486241 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Roles: member,reader,admin May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant: admin May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Name: admin May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User: admin May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Id: default May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Name: Default May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Name: admin May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: method: > May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: exception: Flavor 42 could not be found. May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: action_args: {'id': '42'} May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:56.488140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:56.489279 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:56.490946 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-b3f9b038-aef9-46fc-962f-c7f6fcf047cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:56.492355 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-b3f9b038-aef9-46fc-962f-c7f6fcf047cf admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071801 May 09 18:24:56.492355 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1190 bytes} [Mon May 9 18:24:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:24:56.498320 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-b9ac48e8-7df7-478e-8787-db9e00d53e33 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:56.521491 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-b9ac48e8-7df7-478e-8787-db9e00d53e33 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026860 May 09 18:24:56.522074 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:24:56.532598 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-5a443d45-27f7-41b3-bef8-f0f17edcc467 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:56.555039 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-5a443d45-27f7-41b3-bef8-f0f17edcc467 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026169 May 09 18:24:56.555630 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:24:56.565732 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-3b890f4d-eb45-4ae4-81d8-a67f6539d5e4 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:56.572102 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-3b890f4d-eb45-4ae4-81d8-a67f6539d5e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-3b890f4d-eb45-4ae4-81d8-a67f6539d5e4 admin admin] Request method failure captured: May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept: application/json May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Host: 10.222.0.35 May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABieVx4Mm_APjTrUyJewSBxaYf3pP3z5TXwkz6dt70i4cpcC_sSownvv1Slhuu2JvzZsu5Kd6M42_cTss8HDLLRw63FW6pfJujrmr23O1UpBRCyGwK99ECGWsY590KYrVLbZPfQPzTIwjLm_n9YG3IL_1NbYrxnThOeEpjtg9vWriXPJCg May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Role: member,reader,admin May 09 18:24:56.575485 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Roles: member,reader,admin May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User: admin May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: method: > May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: exception: Flavor 42 could not be found. May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: action_args: {'id': '42'} May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:56.577176 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:56.578725 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:56.579793 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-3b890f4d-eb45-4ae4-81d8-a67f6539d5e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:56.580865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-3b890f4d-eb45-4ae4-81d8-a67f6539d5e4 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014910 May 09 18:24:56.580865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1190 bytes} [Mon May 9 18:24:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:24:57.484228 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-5a443d45-27f7-41b3-bef8-f0f17edcc467 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:57.485248 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-5a443d45-27f7-41b3-bef8-f0f17edcc467 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 09 18:24:57.486144 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:57.677993 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-d15ae154-c852-40df-9ff6-9d17038b2089 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:57.683642 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-d15ae154-c852-40df-9ff6-9d17038b2089 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-d15ae154-c852-40df-9ff6-9d17038b2089 admin admin] Request method failure captured: May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept: application/json May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Host: 10.222.0.35 May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABieVx5BR6RA7Txm6mg-WJ8fxD4CVWWKMegoynI3T_Esda6Wg_ZQAcuHM6YhebGzZn0N0x2BcmcxOzLVOFXqDy17aPiat8onvBe9XzYd9rrlU3IIVZNOC-a15RmWNukD7wTK_lI4B6UjPazBj8s8JY_PRp6lqY-aEvLsgoKr-ndJ-8dh-s May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Role: member,reader,admin May 09 18:24:57.685293 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Roles: member,reader,admin May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User: admin May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: method: > May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: exception: Flavor 84 could not be found. May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: action_args: {'id': '84'} May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:57.686809 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:57.687865 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:57.689062 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-d15ae154-c852-40df-9ff6-9d17038b2089 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:57.690233 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-d15ae154-c852-40df-9ff6-9d17038b2089 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065354 May 09 18:24:57.690233 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1190 bytes} [Mon May 9 18:24:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:24:57.696935 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-969d6e17-2056-434b-b56d-258c1b3d1f10 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:57.710936 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-969d6e17-2056-434b-b56d-258c1b3d1f10 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017550 May 09 18:24:57.711483 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:57.721504 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-fd894ae7-c9bc-4968-95ed-9bb3d2715101 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:57.736141 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-fd894ae7-c9bc-4968-95ed-9bb3d2715101 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018307 May 09 18:24:57.736711 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:57.746994 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-0e2e633f-b972-45ac-b444-ed1d09a157bd admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:57.752894 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.wsgi [None req-0e2e633f-b972-45ac-b444-ed1d09a157bd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-0e2e633f-b972-45ac-b444-ed1d09a157bd admin admin] Request method failure captured: May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept: application/json May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept-Encoding: gzip, deflate May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Connection: keep-alive May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Content-Length: 0 May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Host: 10.222.0.35 May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-Api-Version: compute 2.90 May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-System-Scope: None May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: User-Agent: python-novaclient May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Auth-Token: gAAAAABieVx5BR6RA7Txm6mg-WJ8fxD4CVWWKMegoynI3T_Esda6Wg_ZQAcuHM6YhebGzZn0N0x2BcmcxOzLVOFXqDy17aPiat8onvBe9XzYd9rrlU3IIVZNOC-a15RmWNukD7wTK_lI4B6UjPazBj8s8JY_PRp6lqY-aEvLsgoKr-ndJ-8dh-s May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Id: None May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Name: None May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Identity-Status: Confirmed May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Is-Admin-Project: True May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Id: default May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Name: Default May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Name: admin May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Role: member,reader,admin May 09 18:24:57.754443 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Roles: member,reader,admin May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant: admin May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Name: admin May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User: admin May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Id: default May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Name: Default May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Name: admin May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: method: > May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: exception: Flavor 84 could not be found. May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: action_args: {'id': '84'} May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:57.756100 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:57.756922 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:57.757966 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-0e2e633f-b972-45ac-b444-ed1d09a157bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:57.759054 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-0e2e633f-b972-45ac-b444-ed1d09a157bd admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012858 May 09 18:24:57.759054 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1190 bytes} [Mon May 9 18:24:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:24:58.678795 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-fd894ae7-c9bc-4968-95ed-9bb3d2715101 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:58.679827 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-fd894ae7-c9bc-4968-95ed-9bb3d2715101 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 09 18:24:58.680275 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:58.880378 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-ecf32fed-2d2a-4435-a0bd-fa6837b2b7a8 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:58.886778 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.wsgi [None req-ecf32fed-2d2a-4435-a0bd-fa6837b2b7a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-ecf32fed-2d2a-4435-a0bd-fa6837b2b7a8 admin admin] Request method failure captured: May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept: application/json May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Accept-Encoding: gzip, deflate May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Connection: keep-alive May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Content-Length: 0 May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Host: 10.222.0.35 May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-Api-Version: compute 2.90 May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Openstack-System-Scope: None May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: User-Agent: python-novaclient May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Auth-Token: gAAAAABieVx6dAW23mShJwTfsnlSWLDCdJFXJ4pPu1NS_qkgQaocp3KFZcfWAs0bKNmINB_Lll0iUg9iVASz31iN-Z41GtfJFCpx6NwSXvdqyPQkFQUYd4koXwaECefCO2f_FB9NMpVpk4at87niJNQ-Nk7dspHnIC-2mBEhGNJynRUI9t2RtIw May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Id: None May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Domain-Name: None May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Identity-Status: Confirmed May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Is-Admin-Project: True May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Id: default May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Domain-Name: Default May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Project-Name: admin May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Role: member,reader,admin May 09 18:24:58.888350 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Roles: member,reader,admin May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant: admin May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-Tenant-Name: admin May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User: admin May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Id: default May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Domain-Name: Default May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: X-User-Name: admin May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: method: > May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: exception: Flavor 451 could not be found. May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: action_args: {'id': '451'} May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:58.889836 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:58.890738 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: ERROR nova.api.openstack.wsgi May 09 18:24:58.891876 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-ecf32fed-2d2a-4435-a0bd-fa6837b2b7a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:58.893061 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-ecf32fed-2d2a-4435-a0bd-fa6837b2b7a8 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070977 May 09 18:24:58.893061 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:24:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 09 18:24:58.900196 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-13a0f585-b66b-4e82-813a-dadca0e14165 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:58.916223 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-13a0f585-b66b-4e82-813a-dadca0e14165 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019513 May 09 18:24:58.916995 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:58.927423 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:58.951379 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027332 May 09 18:24:58.951988 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1210 bytes} [Mon May 9 18:24:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:58.963812 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-5d23bd74-ad2f-4538-b1aa-80e203de8d34 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:58.971184 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-5d23bd74-ad2f-4538-b1aa-80e203de8d34 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-5d23bd74-ad2f-4538-b1aa-80e203de8d34 admin admin] Request method failure captured: May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept: application/json May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Host: 10.222.0.35 May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABieVx6dAW23mShJwTfsnlSWLDCdJFXJ4pPu1NS_qkgQaocp3KFZcfWAs0bKNmINB_Lll0iUg9iVASz31iN-Z41GtfJFCpx6NwSXvdqyPQkFQUYd4koXwaECefCO2f_FB9NMpVpk4at87niJNQ-Nk7dspHnIC-2mBEhGNJynRUI9t2RtIw May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Role: member,reader,admin May 09 18:24:58.973521 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Roles: member,reader,admin May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eee4d3b959644fd685ed39be9bf16ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eee4d3b959644fd685ed39be9bf16ada"}]}] May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Id: eee4d3b959644fd685ed39be9bf16ada May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User: admin May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Id: e096708f2ffb48ba87055d074176a343 May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: method: > May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: exception: Flavor 451 could not be found. May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: action_args: {'id': '451'} May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:24:58.975776 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:58.976930 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 09 18:24:58.978437 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-5d23bd74-ad2f-4538-b1aa-80e203de8d34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:24:58.979716 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-5d23bd74-ad2f-4538-b1aa-80e203de8d34 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015182 May 09 18:24:58.979716 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:24:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:24:59.882370 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:59.883466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 09 18:24:59.883886 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:25:00.094608 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a63b35f9-8999-4994-9d0b-d7275ba24d77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:25:00.113867 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a63b35f9-8999-4994-9d0b-d7275ba24d77 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089094 May 09 18:25:00.114424 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1235 bytes} [Mon May 9 18:25:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:25:01.025092 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:25:01.026128 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 May 09 18:25:01.026573 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:25:01.227175 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f0dc0c16-4866-4904-b961-e17c3cc4c134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:25:01.246867 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f0dc0c16-4866-4904-b961-e17c3cc4c134 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080691 May 09 18:25:01.247444 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1235 bytes} [Mon May 9 18:25:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:25:02.146389 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:25:02.147493 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 09 18:25:02.147850 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:25:02.343863 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-2792a875-062b-491b-a6db-4a02851c15b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:25:02.365717 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-2792a875-062b-491b-a6db-4a02851c15b8 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.080724 May 09 18:25:02.366325 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1235 bytes} [Mon May 9 18:25:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:25:03.284489 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:25:03.285531 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 09 18:25:03.285990 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:25:03.490356 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-896e7e99-0b16-4850-b057-f5d1008fba51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:25:03.509825 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-896e7e99-0b16-4850-b057-f5d1008fba51 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083411 May 09 18:25:03.510382 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1235 bytes} [Mon May 9 18:25:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:25:04.424099 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:25:04.425119 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 09 18:25:04.425489 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:25:04.617351 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f8d62ab4-ece3-4791-8c4b-3db2eb906819 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:25:04.638027 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f8d62ab4-ece3-4791-8c4b-3db2eb906819 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078496 May 09 18:25:04.638499 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1202 bytes} [Mon May 9 18:25:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:26:07.546507 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.547520 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-35bec1a8-1fe5-4866-800a-66f9910f1e25 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 09 18:26:07.547992 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 930 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:26:07.608548 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-abfbf635-355c-4499-82b3-2f4f6a276273 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.628645 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-abfbf635-355c-4499-82b3-2f4f6a276273 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074312 May 09 18:26:07.629233 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1291 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:26:07.652989 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-9a8cb58b-c24d-4733-bebc-5dd268bede45 admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.661253 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-9a8cb58b-c24d-4733-bebc-5dd268bede45 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012497 May 09 18:26:07.661807 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1282 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:26:07.674194 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-3402ffc7-08ed-4757-ba83-1eb0df05a8e7 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.684402 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-3402ffc7-08ed-4757-ba83-1eb0df05a8e7 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013812 May 09 18:26:07.684932 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1285 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:26:07.697140 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.705107 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011817 May 09 18:26:07.705629 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1285 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:26:07.725006 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-b4cd682a-6a41-4f5f-b0d0-a8832ec87623 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:26:07.733423 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-b4cd682a-6a41-4f5f-b0d0-a8832ec87623 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013631 May 09 18:26:07.733890 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1282 bytes} [Mon May 9 18:26:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:27.866568 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:27.868434 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002688 May 09 18:29:27.869112 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 34/69] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:28.151337 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:28.152531 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:29:28.152531 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:29:28.153988 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:28.154291 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:28.155081 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:28.155501 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:28.190392 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-65bcd1ea-7c73-4192-8411-205d68312bbd admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164623 May 09 18:29:28.190984 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 36/70] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:29:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:29:29.095827 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:29.096902 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 09 18:29:29.097298 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 35/71] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:29.287798 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:29.289483 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:29:29.289483 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:29:29.290832 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:29.291400 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:29.292413 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:29.292931 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:29.312114 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-19263baf-c226-424c-8969-9213e6e845d0 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077628 May 09 18:29:29.312666 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 37/72] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:29:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:29:40.668466 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:40.669486 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 09 18:29:40.669908 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 36/73] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:40.872367 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:40.874406 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:29:40.874406 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:29:40.875752 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:40.876215 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:40.877004 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:40.877432 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:40.901684 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-b9fcfad1-d2d1-4415-9710-16db61447326 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094956 May 09 18:29:40.902245 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 38/74] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:29:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:29:41.807211 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: DEBUG nova.api.openstack.wsgi [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] Calling method '>' {{(pid=102569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:41.808271 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: INFO nova.api.openstack.requestlog [None req-068049d6-b4bc-4356-adb1-a613b7a3070a admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 09 18:29:41.808669 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: [pid: 102569|app: 0|req: 37/75] 10.222.0.35 () {56 vars in 1074 bytes} [Mon May 9 18:29:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:42.018879 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:42.019978 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:29:42.019978 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 09 18:29:42.021206 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:42.021644 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:42.022430 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:42.022848 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:42.045353 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-8076b1ee-c218-4cd8-9cac-2486ba0ff4fe admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089581 May 09 18:29:42.045905 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 39/76] 10.222.0.35 () {60 vars in 1193 bytes} [Mon May 9 18:29:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:30:39.114798 dv-cinder-835881-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 18:30:39.117291 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: Mon May 9 18:30:39 2022 - graceful shutdown triggered... May 09 18:30:39.117807 dv-cinder-835881-8-iscsi devstack@n-api.service[102569]: Gracefully killing worker 2 (pid: 102569)... May 09 18:30:39.118200 dv-cinder-835881-8-iscsi devstack@n-api.service[102568]: Gracefully killing worker 1 (pid: 102568)... May 09 18:30:40.118362 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: worker 1 buried after 1 seconds May 09 18:30:40.118362 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: worker 2 buried after 1 seconds May 09 18:30:40.118362 dv-cinder-835881-8-iscsi devstack@n-api.service[102567]: goodbye to uWSGI. May 09 18:30:40.120192 dv-cinder-835881-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 18:30:40.120836 dv-cinder-835881-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 18:30:40.124365 dv-cinder-835881-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 18:30:40.214471 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 18:30:40 2022] *** May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: nodename: dv-cinder-835881-8-iscsi May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: machine: x86_64 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: clock source: unix May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: pcre jit disabled May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: detected number of CPU cores: 4 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: current working directory: / May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: detected binary path: /usr/bin/uwsgi-core May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: your processes number limit is 47680 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: your memory page size is 4096 bytes May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: detected max file descriptor number: 2048 May 09 18:30:40.229173 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: lock engine: pthread robust mutexes May 09 18:30:40.230134 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: thunder lock: enabled May 09 18:30:40.230134 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 18:30:40.230134 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 18:30:40.275321 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: Python main interpreter initialized at 0x55bdfc5cd9c0 May 09 18:30:40.275321 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: python threads support enabled May 09 18:30:40.275321 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: your server socket listen backlog is limited to 100 connections May 09 18:30:40.275321 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: your mercy for graceful operations on workers is 90 seconds May 09 18:30:40.275738 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: mapped 403077 bytes (393 KB) for 2 cores May 09 18:30:40.275738 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: *** Operational MODE: preforking *** May 09 18:30:40.279406 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: *** uWSGI is running in multiple interpreter mode *** May 09 18:30:40.279406 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: spawned uWSGI master process (pid: 118323) May 09 18:30:40.279406 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: spawned uWSGI worker 1 (pid: 118350, cores: 1) May 09 18:30:40.279406 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: spawned uWSGI worker 2 (pid: 118351, cores: 1) May 09 18:30:40.279406 dv-cinder-835881-8-iscsi devstack@n-api.service[118323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 18:30:40.276272 dv-cinder-835881-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 18:30:41.497423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:30:41.497949 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:30:42.300271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:30:42.300271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: from cryptography.utils import int_from_bytes May 09 18:30:42.300613 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:30:42.300613 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: from cryptography.utils import int_from_bytes May 09 18:30:42.301330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:30:42.301330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: from cryptography.utils import int_from_bytes May 09 18:30:42.301652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:30:42.301652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: from cryptography.utils import int_from_bytes May 09 18:30:44.835128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:30:44.835766 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:30:44.836314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:30:44.837067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:30:44.837336 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:30:44.837735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.838127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.838462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.838792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.839148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.839448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.839777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.840133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.840468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.840733 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.841256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.841363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-8-iscsi {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.841694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.842009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.842374 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.842645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.842955 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.843283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.843596 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.844124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.848075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.849034 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.849527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.850005 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.850601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-8-iscsi {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.851104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.851881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.852545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.853154 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.853676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.854215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.854706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.856819 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.857321 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.857842 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.858356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.858880 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.859382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.859852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.860360 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.860858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.861376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.862145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.862763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.863196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.863681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.864219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.864709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.865216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.865645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.866058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.866550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.867340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.867818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.868331 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.868825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.869006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:30:44.869521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:30:44.869874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:30:44.870136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.870258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:30:44.870485 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:30:44.870879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.871004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.871207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.871531 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.871847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.872214 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.872450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.872577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.872835 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.873161 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.873466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.873587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.873737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.874054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.874368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.874479 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-8-iscsi {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.874692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.875003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.875279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.875404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.875627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.875934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.876242 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.876364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.876712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.877225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.877859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.877859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.878139 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.878411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.878510 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.878784 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.879120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.879369 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.879482 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.879712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.880078 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.880395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.880648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.880796 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-8-iscsi {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.881126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.881444 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.881763 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.882101 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.882233 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.882493 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.882804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.883124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.883453 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.883656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.883904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.884283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.884570 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.884673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.884940 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.885266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.885575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.885848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.885951 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.886217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.886538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.886855 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.887014 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.887296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.887552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.887887 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.888312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.888636 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.888962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.889216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.889469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.889790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.890110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.890422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.890731 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.891040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.891171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892373 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892655 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.892973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893057 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893477 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.893929 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894066 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894604 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.894915 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895251 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.895899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896042 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896370 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896576 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.896896 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897723 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.897835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898378 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.898936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899078 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899510 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.899865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.900889 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901166 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.901921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902771 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.902924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903326 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.903996 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904277 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.904929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905383 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905833 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.905974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.906105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.906237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.906436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.906633 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.907042 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.907574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.907574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.907865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.908043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.908229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.908416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.908702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.908863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.909938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.910862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.911031 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.911185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.911324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.911468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.911598 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.911727 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.911857 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.912155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.912302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.912445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.912604 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.912758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.912937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.913096 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.913251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.913397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.913549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.913702 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.913943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.914159 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.914317 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.914464 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.914619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.914619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.914909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.914909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.915288 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.915445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.915598 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.915746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.915746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.916062 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:30:44.916285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.916444 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.916598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.916752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.916923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.917634 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.917739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.917829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.917933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918094 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918177 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918252 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918252 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918487 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.918557 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920461 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.920952 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921033 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921260 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921334 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921564 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921637 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.921890 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922520 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.922975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.923083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.923295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.923412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.923750 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.923883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.924440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.924776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.925129 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.925473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.925887 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.926241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.926566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.926893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.927247 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.927679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.927792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.927974 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.928159 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.928312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.928526 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.928666 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.928891 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929029 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.929945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930484 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930604 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.930978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.931204 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.931310 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.931544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.931642 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.931913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.932074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.932271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.932487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.932716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.932872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933184 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933338 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.933871 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934297 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.934987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935091 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935763 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.935931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.936068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.936266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.936578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.936894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.937080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.937255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.937498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.937627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.937884 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.938099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.938422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.938734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.939046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.939370 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.939678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940635 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.940948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.941621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.941746 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.941873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.941995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.942814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.943162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.943416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.943554 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.943697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.943850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944696 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.944839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945330 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.945836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.946049 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.946357 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.946514 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.946660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.946896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.947098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.947230 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.947600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.947744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.947903 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948251 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948529 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.948984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.949117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.949341 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.949581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.949804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.949981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.950153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.950324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.950592 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.950732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951472 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.951922 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952130 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.952883 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953672 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.953968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954123 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954272 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954567 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.954876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955598 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.955908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956095 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956542 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956695 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.956848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957296 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.957927 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.958948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.959834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.960082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.960260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.960987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961154 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961610 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.961908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962281 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962588 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.962875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963091 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.963988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.964195 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.964362 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.964696 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.964861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.965728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966010 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966313 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966457 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.966941 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.967101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.967247 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.967390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.967543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.967686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968010 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968183 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.968874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969170 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969756 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.969913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970453 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.970904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971495 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971653 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.971829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.972872 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.973923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974372 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974526 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974672 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.974973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.975246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.975515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.975668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.975822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976076 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976226 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976541 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.976877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977164 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977307 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977616 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.977768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978396 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.978975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979715 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.979866 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.980876 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981328 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981481 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.981919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.982603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.982760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.982906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983349 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983663 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.983990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984757 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.984916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.985061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.985212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.985364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.985515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.985851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.986131 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.986401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.986563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.986563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.986857 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987635 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.987925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.988342 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.988494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.988647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.988809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.988809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.989251 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.989408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.989555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.989706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.989851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990307 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990474 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.990999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.991924 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992103 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992402 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992724 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.992877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.993030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.993195 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.993349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.993503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.993667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.994155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.994358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.994518 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.994747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.994902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.995935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996273 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996720 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.996872 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997016 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997311 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997464 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997619 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.997775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998514 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.998973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.999214 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.999372 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.999531 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.999684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:44.999831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000330 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000636 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.000871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001788 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.001949 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002094 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002313 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002475 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002768 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.002911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003055 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003208 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003361 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.003960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004284 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.004896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005496 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.005987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.006974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007262 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007414 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007726 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.007872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.008100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.008248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.008400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.008701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.008862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009406 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.009864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010568 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010735 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.010904 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011726 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.011726 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012179 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012486 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012843 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012996 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.012996 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.013279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.013437 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.013582 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.013734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.013917 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014681 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.014976 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015284 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.015886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.016980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017134 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017288 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017584 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.017882 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018491 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018780 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.018943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.019962 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.020865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.021987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022590 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022748 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.022894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.023920 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.024107 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.024107 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.024391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.024643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.024906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025845 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.025995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.026153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.026298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.026443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.026707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.026873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027037 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027638 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027793 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.027937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.028116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.028262 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.028406 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.028406 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.028702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029830 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.029986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030278 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030598 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030751 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.030902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031441 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.031915 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.032084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.032557 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.032557 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.032915 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033360 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033798 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.033941 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034235 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034842 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.034842 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035728 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.035872 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036695 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.036927 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037085 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037387 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.037904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038057 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038370 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.038816 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039737 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.039902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040625 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.040927 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041081 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041263 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.041963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042713 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.042866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.043718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044076 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044233 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.044981 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045571 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.045873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046330 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046496 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046800 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.046959 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.047138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.047385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.047551 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.047711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.047864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048052 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048207 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048374 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048530 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048681 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.048985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.049273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.049440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.049601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.049753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.049914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050326 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050485 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.050937 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.051087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.051254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.051414 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.051566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.051794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052181 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052513 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.052829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.053902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054384 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.054839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055683 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.055843 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056029 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.056901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057655 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057812 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.057977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058289 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058446 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.058919 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.059072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.059369 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.059540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.059701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.059852 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.060860 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.061917 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062076 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062379 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062708 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.062873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063510 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.063821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064576 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.064889 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065048 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065376 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065536 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.065862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066163 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066465 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.066949 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067262 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.067821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068162 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068477 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.068970 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.069122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.069283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.069601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.069758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.069917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070228 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070389 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070702 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.070855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071006 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071006 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071474 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071625 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.071784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.072870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073360 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073519 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.073990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.074781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075079 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.075848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076383 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076700 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.076700 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077163 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077163 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.077782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078050 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.078981 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.079131 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.079304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.079617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.079792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.079969 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080179 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080829 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.080980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081281 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081592 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.081917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082811 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.082962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.083906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.084734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085335 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.085914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086697 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.086848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087466 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.087929 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.088255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.088428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.088581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.088733 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.088891 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089499 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.089973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090292 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.090903 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.091819 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092021 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092591 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092742 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.092894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093675 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.093987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094310 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.094946 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.095885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.096880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097033 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097493 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097493 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097795 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.097945 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098530 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.098999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.099161 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.099312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.099470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.099470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.099919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100586 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100751 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.100909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.101851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.102870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103029 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.103859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104389 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104564 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104725 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.104883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.105811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.106887 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.107994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.108299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.108461 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.108753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.108911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.109072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.109223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.109377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.109536 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.109696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.110905 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.111658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.112769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.113914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114112 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.114908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.115068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.115234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.115397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.115556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.115714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.116967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117130 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.117892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.118180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.118329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.118488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.118648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.118902 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119068 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119068 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119403 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119729 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.119889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.120209 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.120209 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.120526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.120689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.120842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121153 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121474 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.121939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122088 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.122811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123105 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123256 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123418 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.123889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.124888 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125843 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.125995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126618 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.126928 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.127898 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128085 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128714 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.128866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129134 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129296 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.129935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.130099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.130400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.130551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.130703 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.130853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131020 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.131829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132218 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132370 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132699 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.132928 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133410 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.133888 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.134822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135186 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135496 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135816 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.135995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136302 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136615 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.136774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137072 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.137974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138737 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.138895 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139055 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139319 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.139495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.140866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:30:45.142017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:30:45.160701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_db.sqlalchemy.engines [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.166794 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_db.sqlalchemy.engines [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.230261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.context [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f91d991-cb29-42d8-aa28-79062e35eafc(cell1) {{(pid=118351) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:30:45.235839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:45.238041 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:45.238869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:45.241111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.context [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f91d991-cb29-42d8-aa28-79062e35eafc(cell1) {{(pid=118350) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:30:45.241988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:45.246243 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:45.247604 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:45.248792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:45.250744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:45.253557 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_db.sqlalchemy.engines [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.255480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_db.sqlalchemy.engines [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.264930 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_db.sqlalchemy.engines [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.265845 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_db.sqlalchemy.engines [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.421976 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_db.sqlalchemy.engines [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.434808 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_db.sqlalchemy.engines [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:30:45.779691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: WARNING keystonemiddleware.auth_token [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:30:45.786683 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: WARNING keystonemiddleware.auth_token [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:30:45.787779 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: WARNING keystonemiddleware.auth_token [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:30:45.794705 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: WARNING keystonemiddleware.auth_token [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:30:46.186142 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: WARNING keystonemiddleware.auth_token [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:30:46.193271 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: WARNING keystonemiddleware.auth_token [None req-450c9b00-558e-4049-b353-f3e424294a08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:30:46.196147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: WARNING keystonemiddleware.auth_token [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:30:46.199821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdfc5cd9c0 pid: 118350 (default app) May 09 18:30:46.203328 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: WARNING keystonemiddleware.auth_token [None req-ce298fd9-c73d-43bf-bbcc-43036e0ad05a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:30:46.208580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdfc5cd9c0 pid: 118351 (default app) May 09 18:31:28.971868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8a449e6b-478a-49d4-96ae-542010289eae tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Action: 'create', calling method: .version_select at 0x7fe8c0c08280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-912879682", "metadata": {"Type": "work"}}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8a449e6b-478a-49d4-96ae-542010289eae tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 121 May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:28.996515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-912879682", "metadata": {"Type": "work"}}} May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:28.998237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-912879682', 'metadata': {'Type': 'work'}}}} May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise error May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi '#$%' May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:28.999264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:31:29.000972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:31:29.002377 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:31:29.002377 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.003978 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8a449e6b-478a-49d4-96ae-542010289eae tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:29.005561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8a449e6b-478a-49d4-96ae-542010289eae tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.416076 May 09 18:31:29.006315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1155 bytes} [Mon May 9 18:31:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1418 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:31:29.019544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9b0a12a4-12aa-4ed4-814a-f29e92e7144e tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Action: 'create', calling method: .version_select at 0x7fe8c0aa15e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2002386109", "metadata": {"Type": "work"}}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9b0a12a4-12aa-4ed4-814a-f29e92e7144e tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 120 May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:29.022498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2002386109", "metadata": {"Type": "work"}}} May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:29.024223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2002386109', 'metadata': {'Type': 'work'}}}} May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise error May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi '0' May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:29.025063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:31:29.026375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:31:29.027452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:31:29.027452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.032739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9b0a12a4-12aa-4ed4-814a-f29e92e7144e tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:29.033587 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9b0a12a4-12aa-4ed4-814a-f29e92e7144e tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021425 May 09 18:31:29.034171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 2/2] 10.222.0.35 () {60 vars in 1155 bytes} [Mon May 9 18:31:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 18:31:29.048424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-bdee5b25-1192-4bdd-a956-9c3706e3a197 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Action: 'create', calling method: .version_select at 0x7fe8c0c085e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-690149707", "metadata": {"Type": "work"}}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-bdee5b25-1192-4bdd-a956-9c3706e3a197 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 118 May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:29.053069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-690149707", "metadata": {"Type": "work"}}} May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:29.054431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-690149707', 'metadata': {'Type': 'work'}}}} May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise error May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi '' May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:29.055349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:31:29.056707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:31:29.057839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:31:29.057839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:29.062970 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-bdee5b25-1192-4bdd-a956-9c3706e3a197 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:29.064126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-bdee5b25-1192-4bdd-a956-9c3706e3a197 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024181 May 09 18:31:29.066617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 3/3] 10.222.0.35 () {60 vars in 1155 bytes} [Mon May 9 18:31:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 18:31:29.078790 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-22b49127-1fe3-495d-bcbd-2b986cd0af85 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Calling method '.version_select at 0x7fe8c0abe280>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:29.318017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d94dc710-2c0a-4045-bb7a-1af031b8c3c7 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Action: 'create', calling method: .version_select at 0x7fe8c0c09280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2012146177"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:30.423759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-22b49127-1fe3-495d-bcbd-2b986cd0af85 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] HTTP exception thrown: Volume tempest-invalid-519232566 could not be found. May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-22b49127-1fe3-495d-bcbd-2b986cd0af85 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-519232566 HTTP/1.1 May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:30.428148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Volume tempest-invalid-519232566 could not be found. May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'tempest-invalid-519232566'} May 09 18:31:30.429705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-519232566 could not be found. (HTTP 404) (Request-ID: req-b8bc2296-3cde-4705-b7fc-de03a419ee5c) May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:30.430640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:30.432073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-519232566 could not be found. May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:30.433400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-519232566 could not be found. May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-519232566 could not be found. May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-22b49127-1fe3-495d-bcbd-2b986cd0af85 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 404 to user: Volume tempest-invalid-519232566 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-22b49127-1fe3-495d-bcbd-2b986cd0af85 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-519232566" status: 404 len: 98 microversion: 2.1 time: 1.361108 May 09 18:31:30.434799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 4/4] 10.222.0.35 () {58 vars in 1214 bytes} [Mon May 9 18:31:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-519232566 => generated 98 bytes in 1363 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 09 18:31:30.682792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1220397501", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "networks": [{"uuid": "c74e71f1-1464-4e45-9eb5-d8aa67eb07c6"}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:31.020022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] validate_networks() for [('c74e71f1-1464-4e45-9eb5-d8aa67eb07c6', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:31.716767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d94dc710-2c0a-4045-bb7a-1af031b8c3c7 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.941957 May 09 18:31:31.717933 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 1/5] 10.222.0.35 () {60 vars in 1154 bytes} [Mon May 9 18:31:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3945 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 18:31:31.730952 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d969da89-1f3a-4f98-a461-a30f8e1fea3a tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011272 May 09 18:31:31.737415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 2/6] 10.222.0.35 () {58 vars in 1139 bytes} [Mon May 9 18:31:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 18:31:31.748610 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-262d8ae6-a62c-4809-a725-5bb47d2bc9cb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a644c0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:31.994916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-262d8ae6-a62c-4809-a725-5bb47d2bc9cb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 200 len: 345 microversion: 2.1 time: 0.256309 May 09 18:31:32.000422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 3/7] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:31 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:32.003910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4789e0ea-409c-454b-ad6e-7a7c95162761 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006912 May 09 18:31:32.004633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1136 bytes} [Mon May 9 18:31:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 18:31:32.028235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e393b647-9960-4d27-8c90-50ffe0059edc tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Calling method '.version_select at 0x7fe8c0a643a0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:32.120950 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-e393b647-9960-4d27-8c90-50ffe0059edc tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] HTTP exception thrown: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e393b647-9960-4d27-8c90-50ffe0059edc tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/os-volumes/a8ce41bf-a00d-4938-ad5a-c11b99906185 HTTP/1.1 May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:31:32.126544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'a8ce41bf-a00d-4938-ad5a-c11b99906185'} May 09 18:31:32.127914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. (HTTP 404) (Request-ID: req-c7f4f3bb-e674-4b23-976f-e8cb85e844f0) May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.128789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:32.129930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:31:32.131103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e393b647-9960-4d27-8c90-50ffe0059edc tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 404 to user: Volume a8ce41bf-a00d-4938-ad5a-c11b99906185 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e393b647-9960-4d27-8c90-50ffe0059edc tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/a8ce41bf-a00d-4938-ad5a-c11b99906185" status: 404 len: 109 microversion: 2.1 time: 0.117296 May 09 18:31:32.133791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 5/9] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:31:32 2022] DELETE /compute/v2.1/os-volumes/a8ce41bf-a00d-4938-ad5a-c11b99906185 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 18:31:32.141483 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-980b6f49-e548-4b31-b1ee-65e3cef40285 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Calling method '.version_select at 0x7fe8c14348b0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:32.222410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-980b6f49-e548-4b31-b1ee-65e3cef40285 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] HTTP exception thrown: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-980b6f49-e548-4b31-b1ee-65e3cef40285 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Request method failure captured: May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/os-volumes/605dca1c-6682-48eb-92e5-166e324c1219 HTTP/1.1 May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV3_dN2vnNSrM4JPy-7nYNFsVnIOsWawWSp8pV80dVA7g8oKITcDNlMen1bs8oRQgfTmg3fDv-GO3aGDl87gd5lS4ig37dHWOzb28VIKvyMhSjSCsr42gI8Tuc71SFZu5yf4v9N-vWKZnIlBESIyiLpn5HQRnAQLPjbbfbZhWqkDkCI May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:31:32.224467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c286bc2d6dd34651884d3ef9fb4b09be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c286bc2d6dd34651884d3ef9fb4b09be"}]}] May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: c286bc2d6dd34651884d3ef9fb4b09be May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-VolumesNegativeTest-1735514167 May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 52f5d7b5d9a341f2891246633704d57c May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-VolumesNegativeTest-1735514167-project May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '605dca1c-6682-48eb-92e5-166e324c1219'} May 09 18:31:32.225777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. (HTTP 404) (Request-ID: req-f75f38a3-4b28-49c2-bba1-f61afa5cf102) May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.226641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:32.227823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:31:32.229036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-980b6f49-e548-4b31-b1ee-65e3cef40285 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] Returning 404 to user: Volume 605dca1c-6682-48eb-92e5-166e324c1219 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:32.230155 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-980b6f49-e548-4b31-b1ee-65e3cef40285 tempest-VolumesNegativeTest-1735514167 tempest-VolumesNegativeTest-1735514167-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/605dca1c-6682-48eb-92e5-166e324c1219" status: 404 len: 109 microversion: 2.1 time: 0.088843 May 09 18:31:32.236817 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 6/10] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:32 2022] GET /compute/v2.1/os-volumes/605dca1c-6682-48eb-92e5-166e324c1219 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:31:33.009910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-91b0a912-bd28-42e4-83be-d3c20b32b633 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a4d1f0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.129165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-91b0a912-bd28-42e4-83be-d3c20b32b633 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 200 len: 346 microversion: 2.1 time: 0.125615 May 09 18:31:33.130289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 7/11] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:33.141998 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2e058a99-9f00-456a-96a3-7787fbc01532 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Action: 'create', calling method: .version_select at 0x7fe8c0a4d820>, body: {"snapshot": {"volume_id": "e237ec5f-e6f5-49de-91dc-4a37c586c918", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1096286806"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:33.628468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2e058a99-9f00-456a-96a3-7787fbc01532 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.490528 May 09 18:31:33.629473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 8/12] 10.222.0.35 () {60 vars in 1161 bytes} [Mon May 9 18:31:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:31:33.645701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b9babf3e-4e21-4067-b03b-3350d5f90a3b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0c09c10>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.808919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b9babf3e-4e21-4067-b03b-3350d5f90a3b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 287 microversion: 2.1 time: 0.172007 May 09 18:31:33.815547 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 9/13] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:33.822182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2e76fd89-6922-4a63-9874-fc26b3a2f436 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c1434790>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.937403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2e76fd89-6922-4a63-9874-fc26b3a2f436 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.120120 May 09 18:31:33.946126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 10/14] 10.222.0.35 () {58 vars in 1139 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:33.951417 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b947701f-7441-4cc0-9d46-4a83fd98476d tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a561f0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.999767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b947701f-7441-4cc0-9d46-4a83fd98476d tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 287 microversion: 2.1 time: 0.052059 May 09 18:31:34.005255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 11/15] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:34.503710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:34.504341 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:34.505004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:34.505638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:34.506232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:34.533113 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:34.533547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:34.544471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:34.545181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:34.594328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Getting quotas for project 3f4643e347d54eef897b2b9c9b14f804. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:34.604925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Getting quotas for user 5240a913f80342b981c1c52ebe90ca1f and project 3f4643e347d54eef897b2b9c9b14f804. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:34.620868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:34.623846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:34.822739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e2273554-6932-46b5-9109-ca1b518bfd0c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.387595 May 09 18:31:34.829277 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 5/16] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:31:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:34.834062 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1ffe5a3c-1649-41cf-8e40-05b4525cbd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:34.834833 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1ffe5a3c-1649-41cf-8e40-05b4525cbd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:35.030179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1ffe5a3c-1649-41cf-8e40-05b4525cbd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:35.036252 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-40bc26b0-7a7e-41e2-995f-eecaa64e64f1 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c00f03a0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:35.074825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1ffe5a3c-1649-41cf-8e40-05b4525cbd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1215 microversion: 2.1 time: 0.242719 May 09 18:31:35.080051 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 12/17] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:34 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:35.154720 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-40bc26b0-7a7e-41e2-995f-eecaa64e64f1 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 287 microversion: 2.1 time: 0.146695 May 09 18:31:35.157116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 6/18] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:35 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:36.097502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3901a788-8205-4f41-8fd7-6058b3dbc06e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:36.098780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3901a788-8205-4f41-8fd7-6058b3dbc06e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:36.170085 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-be48da75-e94d-4b64-9b3b-06b60c8822f3 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c00f0af0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:36.232451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3901a788-8205-4f41-8fd7-6058b3dbc06e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:36.237305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-be48da75-e94d-4b64-9b3b-06b60c8822f3 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 287 microversion: 2.1 time: 0.073238 May 09 18:31:36.238331 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 7/19] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:36 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:31:36.244329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3901a788-8205-4f41-8fd7-6058b3dbc06e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1215 microversion: 2.1 time: 0.150933 May 09 18:31:36.245867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 13/20] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:36 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:36.842215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-254fc645-6226-46b4-ab37-ced8c5fb198f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: .version_select at 0x7fe8c00e1f70>, body: {"keypair": {"name": "tempest-keypair-1020117861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKam6Y+XhHdDXtnc4TsKaNggcbx+l/W0XYnAF8K3pyrFfT8lm0JihmpPjQvLAW6Y3Ls38oc1uN/y8UKke2MOZ2qKUPRLg3eWiLhp36eV9uD9JGhRNB0Zn3dYywXsFOl2Q=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:36.896687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-254fc645-6226-46b4-ab37-ced8c5fb198f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:36.902636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-254fc645-6226-46b4-ab37-ced8c5fb198f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:36.980132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-254fc645-6226-46b4-ab37-ced8c5fb198f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.740246 May 09 18:31:36.988406 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 8/21] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:37.252644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8d66911a-1123-4024-beb8-63308183358e tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a12af0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:37.266753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-135b8035-afc7-4e39-aeb4-9858e89e747b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:37.268578 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-135b8035-afc7-4e39-aeb4-9858e89e747b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:37.354553 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8d66911a-1123-4024-beb8-63308183358e tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 288 microversion: 2.1 time: 0.108749 May 09 18:31:37.358526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 14/22] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:37 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:37.374840 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d8af1f24-5b6f-412a-ac06-d345ab36f66b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c09a4310>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:37.411363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-135b8035-afc7-4e39-aeb4-9858e89e747b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:37.444535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-135b8035-afc7-4e39-aeb4-9858e89e747b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1215 microversion: 2.1 time: 0.181357 May 09 18:31:37.445343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 9/23] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:37 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:37.665211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d8af1f24-5b6f-412a-ac06-d345ab36f66b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 202 len: 0 microversion: 2.1 time: 0.298106 May 09 18:31:37.688706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 15/24] 10.222.0.35 () {58 vars in 1253 bytes} [Mon May 9 18:31:37 2022] DELETE /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:31:37.701471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5929dfb-db9a-49e1-b315-4b510ef95c39 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c009faf0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:37.797120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a5929dfb-db9a-49e1-b315-4b510ef95c39 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 200 len: 287 microversion: 2.1 time: 0.099867 May 09 18:31:37.797689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 10/25] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:37 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:38.468837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:38.474582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:38.493101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:38.495445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:38.497958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:38.498590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:38.788659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:38.809556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e2975774-6356-40df-9927-1a11ef631aaf tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c00c1ee0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:38.813177 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fc78927e-6fe8-42a9-82b0-9c2d3d7a0f5b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1267 microversion: 2.1 time: 0.354512 May 09 18:31:38.813790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 16/26] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:38 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:38.852451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-e2975774-6356-40df-9927-1a11ef631aaf tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] HTTP exception thrown: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e2975774-6356-40df-9927-1a11ef631aaf tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Request method failure captured: May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 HTTP/1.1 May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_4toQSI4iL1jYRFaUXC5-g_fQ1qM-0QlQXw8jCqezM2CVfXqBMRYC_cqUoHc5JtTIdggUMl21CRhSI0_UimPe2GsLvWBqTFM31Ig6_t1D0H6zj6jF4gYF3ll9_iG7B9ys0J_Jpws26gNJDz5pmUd7UiXcegtfmmHlqn52JdypBAI May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:38.854864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d828dcc698cd451c8e5c25f9ad6879bd"}]}] May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 8fff23e91a3b414f924488aa69959c81 May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '90ab4341-928f-4f2c-8e20-40d02f433438'} May 09 18:31:38.857375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. (HTTP 404) (Request-ID: req-229d8774-339c-4a1a-abed-8bfb3d36bcb6) May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.858153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:38.859223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 18:31:38.861414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e2975774-6356-40df-9927-1a11ef631aaf tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Returning 404 to user: Snapshot 90ab4341-928f-4f2c-8e20-40d02f433438 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e2975774-6356-40df-9927-1a11ef631aaf tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438" status: 404 len: 111 microversion: 2.1 time: 0.051460 May 09 18:31:38.862601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 11/27] 10.222.0.35 () {58 vars in 1250 bytes} [Mon May 9 18:31:38 2022] GET /compute/v2.1/os-snapshots/90ab4341-928f-4f2c-8e20-40d02f433438 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:31:38.875056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8b05795c-20ef-443a-9e72-4b13e87c90ce tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a12c10>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:39.014310 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8b05795c-20ef-443a-9e72-4b13e87c90ce tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 202 len: 0 microversion: 2.1 time: 0.148298 May 09 18:31:39.014880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 17/28] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:31:38 2022] DELETE /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:31:39.024175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-52bc1d2a-f2a4-4a93-9f0b-664aa46a835e tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c0a48940>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:39.110107 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-52bc1d2a-f2a4-4a93-9f0b-664aa46a835e tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 200 len: 345 microversion: 2.1 time: 0.090633 May 09 18:31:39.110932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 12/29] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:39 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:39.832450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:39.833080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:39.859619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.860098 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:39.860885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.861320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:40.022402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:40.037667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e8ead5c6-933b-4282-a08d-6668ba3c3a14 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1267 microversion: 2.1 time: 0.209537 May 09 18:31:40.051581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 18/30] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:39 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:40.139524 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-474ea2df-3a31-44ee-90ff-5339d9f03445 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c009f0d0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:40.212858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-474ea2df-3a31-44ee-90ff-5339d9f03445 tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 200 len: 345 microversion: 2.1 time: 0.093706 May 09 18:31:40.213906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 13/31] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:40 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:40.713259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-808985466", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:40.836587 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1215267704", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e53078e-3a76-4ed9-ad6f-470a933d3075"}], "security_groups": [{"name": "tempest-securitygroup--2018133542"}], "key_name": "tempest-keypair-1020117861", "user_data": "}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:40.864837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] validate_networks() for [('4c9801f3-b3d5-45d8-8351-8d5d5f5ffdea', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:41.090627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] validate_networks() for [('6e53078e-3a76-4ed9-ad6f-470a933d3075', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:42.424104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:42.424801 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:42.425223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:42.425854 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:42.426468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:42.445904 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.446845 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.450208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.451434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.534097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:42.551443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:42.594019 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:42.610988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:42.714096 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-210d67e5-b66b-4cfe-9204-7b67ccbcccae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.884226 May 09 18:31:42.714753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 14/32] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:31:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:42.743107 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:42.745151 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:42.765234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.768166 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.770509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.771226 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.132101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:43.132757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:43.133058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:43.133609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:43.133862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:43.155094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.155867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.156687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.161080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.192896 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:43.227515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:43.228567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2af37fba-94fe-4ad6-b119-6e5e6f10e67c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1273 microversion: 2.1 time: 0.488902 May 09 18:31:43.229224 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 15/33] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:42 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1273 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:43.244747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-32b629f5-66d2-48fe-bbc9-08d15ce3c4eb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8c00c1f70>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.247083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for user eea376d0ec0b45958d63f7a94312d689 and project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:43.278565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:43.281594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-32b629f5-66d2-48fe-bbc9-08d15ce3c4eb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] HTTP exception thrown: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-32b629f5-66d2-48fe-bbc9-08d15ce3c4eb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Request method failure captured: May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 HTTP/1.1 May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_4toQSI4iL1jYRFaUXC5-g_fQ1qM-0QlQXw8jCqezM2CVfXqBMRYC_cqUoHc5JtTIdggUMl21CRhSI0_UimPe2GsLvWBqTFM31Ig6_t1D0H6zj6jF4gYF3ll9_iG7B9ys0J_Jpws26gNJDz5pmUd7UiXcegtfmmHlqn52JdypBAI May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:43.283689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d828dcc698cd451c8e5c25f9ad6879bd"}]}] May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 8fff23e91a3b414f924488aa69959c81 May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e237ec5f-e6f5-49de-91dc-4a37c586c918'} May 09 18:31:43.284951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. (HTTP 404) (Request-ID: req-d84e7e39-3bfd-41eb-9adb-d753ae771db3) May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.285646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:43.286663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:31:43.287634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.288734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.290325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:43.290538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-32b629f5-66d2-48fe-bbc9-08d15ce3c4eb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Returning 404 to user: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:43.291692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-32b629f5-66d2-48fe-bbc9-08d15ce3c4eb tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 404 len: 109 microversion: 2.1 time: 0.051590 May 09 18:31:43.292457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 16/34] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:31:43.306498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4a913086-0f2e-4e65-bfb7-c2241e88db83 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.307430 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4a913086-0f2e-4e65-bfb7-c2241e88db83 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:43.419699 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4a913086-0f2e-4e65-bfb7-c2241e88db83 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:43.429714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4a913086-0f2e-4e65-bfb7-c2241e88db83 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1242 microversion: 2.1 time: 0.134741 May 09 18:31:43.434859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 17/35] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:43.450771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8758afee-eadb-4a13-a803-7b6ddde6c91b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8bafbf700>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.498444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-8758afee-eadb-4a13-a803-7b6ddde6c91b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] HTTP exception thrown: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8758afee-eadb-4a13-a803-7b6ddde6c91b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Request method failure captured: May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: DELETE /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 HTTP/1.1 May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_4toQSI4iL1jYRFaUXC5-g_fQ1qM-0QlQXw8jCqezM2CVfXqBMRYC_cqUoHc5JtTIdggUMl21CRhSI0_UimPe2GsLvWBqTFM31Ig6_t1D0H6zj6jF4gYF3ll9_iG7B9ys0J_Jpws26gNJDz5pmUd7UiXcegtfmmHlqn52JdypBAI May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:43.500762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d828dcc698cd451c8e5c25f9ad6879bd"}]}] May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 8fff23e91a3b414f924488aa69959c81 May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e237ec5f-e6f5-49de-91dc-4a37c586c918'} May 09 18:31:43.502455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. (HTTP 404) (Request-ID: req-3a9a8f49-06b5-4220-8ecb-0c55d6122717) May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.503186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:31:43.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:31:43.505456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.506540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.508116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8758afee-eadb-4a13-a803-7b6ddde6c91b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Returning 404 to user: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:43.509125 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8758afee-eadb-4a13-a803-7b6ddde6c91b tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 404 len: 109 microversion: 2.1 time: 0.063274 May 09 18:31:43.513344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 18/36] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:31:43 2022] DELETE /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:31:43.519152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-90915ce3-d730-4793-a91b-a0b1ecb9158c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.243107 May 09 18:31:43.519798 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 19/37] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:31:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:43.520824 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5eb4ba9-22a7-418e-8587-47fe29a997ff tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Calling method '.version_select at 0x7fe8bafe38b0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.540108 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-32fc7f66-642d-4269-8e64-6dd3de303021 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.540840 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-32fc7f66-642d-4269-8e64-6dd3de303021 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:43.554239 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-a5eb4ba9-22a7-418e-8587-47fe29a997ff tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] HTTP exception thrown: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5eb4ba9-22a7-418e-8587-47fe29a997ff tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Request method failure captured: May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 HTTP/1.1 May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV3_4toQSI4iL1jYRFaUXC5-g_fQ1qM-0QlQXw8jCqezM2CVfXqBMRYC_cqUoHc5JtTIdggUMl21CRhSI0_UimPe2GsLvWBqTFM31Ig6_t1D0H6zj6jF4gYF3ll9_iG7B9ys0J_Jpws26gNJDz5pmUd7UiXcegtfmmHlqn52JdypBAI May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:31:43.557058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d828dcc698cd451c8e5c25f9ad6879bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d828dcc698cd451c8e5c25f9ad6879bd"}]}] May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d828dcc698cd451c8e5c25f9ad6879bd May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240547748 May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 8fff23e91a3b414f924488aa69959c81 May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240547748-project May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e237ec5f-e6f5-49de-91dc-4a37c586c918'} May 09 18:31:43.558412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. (HTTP 404) (Request-ID: req-d9a341f3-9803-48e8-8d3a-354c2ad68e97) May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.559325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:31:43.560385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:31:43.561393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. May 09 18:31:43.562421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:31:43.564388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5eb4ba9-22a7-418e-8587-47fe29a997ff tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] Returning 404 to user: Volume e237ec5f-e6f5-49de-91dc-4a37c586c918 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:31:43.565705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a5eb4ba9-22a7-418e-8587-47fe29a997ff tempest-VolumesSnapshotsTestJSON-240547748 tempest-VolumesSnapshotsTestJSON-240547748-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918" status: 404 len: 109 microversion: 2.1 time: 0.050639 May 09 18:31:43.569475 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 19/38] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/os-volumes/e237ec5f-e6f5-49de-91dc-4a37c586c918 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:31:43.758752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-32fc7f66-642d-4269-8e64-6dd3de303021 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:43.767628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-32fc7f66-642d-4269-8e64-6dd3de303021 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1221 microversion: 2.1 time: 0.237439 May 09 18:31:43.785213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 20/39] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:44.173156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1973601863", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:44.246440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:44.247071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:44.269613 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.270071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.270875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.283004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.362807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] validate_networks() for [('4c9801f3-b3d5-45d8-8351-8d5d5f5ffdea', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:44.874327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:44.883508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-28d21116-a4b9-4fe9-9475-7dc4012a5a1e tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.641401 May 09 18:31:44.884463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 21/40] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:44 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:44.889751 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:44.890692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:44.902082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.903169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.904240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.904895 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.087030 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:45.111703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5ac03aaa-c4de-4531-8498-40861c59aded tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1246 microversion: 2.1 time: 0.225947 May 09 18:31:45.117142 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 22/41] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:44 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1246 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:45.123169 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:45.123738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:45.124731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:45.125641 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:45.126129 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:45.140900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.141431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.142809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.143627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.173487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:45.179984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for user eea376d0ec0b45958d63f7a94312d689 and project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:45.199464 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:45.202469 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:45.327393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42ae662d-b9d3-4900-8ce6-68af19a5954f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.159425 May 09 18:31:45.328098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 20/42] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:31:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:45.342358 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a9e09b0d-511b-46e2-b4f9-c7af44b21a03 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:45.343162 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a9e09b0d-511b-46e2-b4f9-c7af44b21a03 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:45.686897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a9e09b0d-511b-46e2-b4f9-c7af44b21a03 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:45.714790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a9e09b0d-511b-46e2-b4f9-c7af44b21a03 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1222 microversion: 2.1 time: 0.371668 May 09 18:31:45.717294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 23/43] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:45 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:45.902304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:45.903096 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:45.918949 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.931369 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.937936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.940316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:46.141862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:46.142736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:46.163354 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:46.165294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:46.168058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:46.168788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:46.522728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:46.543589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c227d189-684c-4814-a2d3-e833e88f73b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1246 microversion: 2.1 time: 0.407521 May 09 18:31:46.548420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 24/44] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:46 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1246 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:46.644852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:46.657313 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6127e39d-b492-4090-a6e2-ac35439ad9db tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.759603 May 09 18:31:46.661945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 21/45] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:45 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:46.734545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e5ddfa06-27dd-425b-a6f7-a933233061bd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:46.735272 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e5ddfa06-27dd-425b-a6f7-a933233061bd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:47.013989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e5ddfa06-27dd-425b-a6f7-a933233061bd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:47.037680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e5ddfa06-27dd-425b-a6f7-a933233061bd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1222 microversion: 2.1 time: 0.307004 May 09 18:31:47.039815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 25/46] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:46 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:47.572092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:47.573338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:47.610482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.611588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.614973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.616050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.680620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:47.681235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:47.708118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.724948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.725482 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.725990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.823387 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:47.833518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6b929d9b-61b3-4664-b6a7-ee129cfa3e9a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1294 microversion: 2.1 time: 0.272354 May 09 18:31:47.837202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 22/47] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:47 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:48.061566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:48.062194 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:48.063075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:48.071600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0664d956-e6a5-426f-bddb-d6cfea49f50b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.395834 May 09 18:31:48.077333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 26/48] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:47 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:48.083833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.084343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.093186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.096043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.293227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:48.303362 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e03b338f-54fe-439e-bd7c-51c5726b9e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1218 microversion: 2.1 time: 0.246151 May 09 18:31:48.304048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 23/49] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:48 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:48.854388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:48.855762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:48.873586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.874050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.874862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.875303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.165874 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.180752 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c3ca2f8e-3ecc-496a-b4a7-1d1561c65e6f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1294 microversion: 2.1 time: 0.330775 May 09 18:31:49.191513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 24/50] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:48 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1294 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:49.198649 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:49.199496 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:49.223939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.225362 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.226350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.226743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.307724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-96be406f-b45f-4bd2-addc-f1319a0e2a7f req-58227fcc-e841-4039-ad01-59e94dc8f560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558654f6-195d-477d-a28d-ca674785bad6", "tag": "432f32a7-4190-4b3e-af78-a0f95c8aa2c9"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:49.326827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-96be406f-b45f-4bd2-addc-f1319a0e2a7f req-58227fcc-e841-4039-ad01-59e94dc8f560 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.327506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-96be406f-b45f-4bd2-addc-f1319a0e2a7f req-58227fcc-e841-4039-ad01-59e94dc8f560 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.351434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-96be406f-b45f-4bd2-addc-f1319a0e2a7f req-58227fcc-e841-4039-ad01-59e94dc8f560 service nova] Creating event network-changed:432f32a7-4190-4b3e-af78-a0f95c8aa2c9 for instance 558654f6-195d-477d-a28d-ca674785bad6 on hv-cinder-83588 May 09 18:31:49.352340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-96be406f-b45f-4bd2-addc-f1319a0e2a7f req-58227fcc-e841-4039-ad01-59e94dc8f560 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 18:31:49.354168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.354851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.355863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.356876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.367707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.compute.rpcapi [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 18:31:49.369623 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] Releasing lock "compute-rpcapi-router" {{(pid=118351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 18:31:49.388457 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a318241e-9bdb-4b0c-8164-025076a2bc14 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553561 May 09 18:31:49.389669 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 27/51] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:49.396593 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:49.397708 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:49.405624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.406781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.408003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.408898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.504716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.513755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a1352167-8e6d-4a30-94e1-7b50da0d149c tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.320843 May 09 18:31:49.523868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.524164 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 25/52] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:49 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:49.533691 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e1658e9a-6f70-4ad7-9ba6-fcba517d89c9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1274 microversion: 2.1 time: 0.142501 May 09 18:31:49.534278 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 28/53] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:49 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:50.198682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:50.199269 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:50.209451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.210218 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.211985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.213424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.287462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:50.294764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0914a8ae-0ce9-4bc2-a397-00fcfd1e7720 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1302 microversion: 2.1 time: 0.100673 May 09 18:31:50.295531 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 26/54] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:50.531721 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:50.532366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:50.538934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.539781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.540589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.547327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.551925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:50.552816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:50.564603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.565563 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.567599 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.568562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.689545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:50.699280 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c31de4d1-0cb2-4b1e-bb32-4c4f9a800ffd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1274 microversion: 2.1 time: 0.152603 May 09 18:31:50.704862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 27/55] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:50.781869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:50.790001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c4f8989a-b256-4cdb-ba49-b4c23de6a669 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.263070 May 09 18:31:50.791119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 29/56] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:51.312518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.313926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.320435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.321232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.322285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.322799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.407556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:51.416497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d69fe1c1-e876-4fd4-8506-76881245dc95 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1302 microversion: 2.1 time: 0.107790 May 09 18:31:51.417925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 28/57] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:51 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:51.720554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.724946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.737545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.738431 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.739377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.740037 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.807493 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.808481 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.821246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.822047 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.823042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.823677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.855089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:51.864806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f01ce1f2-b85c-4760-a030-613b94d99131 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1274 microversion: 2.1 time: 0.151201 May 09 18:31:51.865980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 30/58] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:51 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:52.154127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:52.169472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-38ad871a-9c2e-4b68-bd67-d2674a3900ac tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.360038 May 09 18:31:52.170786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 29/59] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:51 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:52.443371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:52.444053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:52.450527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.450991 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.451977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.452436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.553732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:52.562787 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fa46e20e-f267-4c20-a609-68d3f859c0ae tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1302 microversion: 2.1 time: 0.123522 May 09 18:31:52.564349 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 31/60] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:52 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1302 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:52.881777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:52.882427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:52.898630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.899099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.902046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.902508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.092906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.111666 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d37d30bc-0a85-4301-a527-69d8f4aa0034 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1274 microversion: 2.1 time: 0.226857 May 09 18:31:53.113858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 30/61] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:52 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:53.189011 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:53.190646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:53.201222 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.208747 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.214792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.216831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.558892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.573849 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-221ce971-5adf-4f3e-ba79-0b36634d0db5 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.385067 May 09 18:31:53.576313 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 32/62] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:53 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:53.604197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:53.605879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:53.636370 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.636893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.638858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.639323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.770516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.787608 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2919521e-6c74-4d94-9d7f-f2c31e99b1b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1302 microversion: 2.1 time: 0.204965 May 09 18:31:53.790031 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 31/63] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:53 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:54.132603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.133236 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.149955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.150164 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.151006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.151527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.313165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:54.324560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d7be6945-474c-4884-b680-09443f4c7847 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1274 microversion: 2.1 time: 0.194652 May 09 18:31:54.328801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 33/64] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:54.593064 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.593679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.609253 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.610662 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.614291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.616314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.821731 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.826201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.847497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.848153 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.849147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.853150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.520008 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.545810 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5536c1dc-b696-4bd4-8b28-78f2d5e803ef tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.730626 May 09 18:31:55.559415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 34/65] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:55.567835 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:55.568480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:55.577765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.582738 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:55.588247 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.589773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a5be7bc0-4a75-4310-a7d8-040ed26866f2 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 1.000626 May 09 18:31:55.594166 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 32/66] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:55.605181 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:55.607389 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.777172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.794667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c1a97b2c-a8f1-4a72-9224-abe689566100 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.232359 May 09 18:31:55.809032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 35/67] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:55 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:56.564136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.564912 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.571842 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.572352 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.573111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.573549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.606772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.619428 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.626879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.628016 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.628160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.628755 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.651000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.659346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-237970ec-d965-48e4-b228-7934f1400726 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.099064 May 09 18:31:56.660368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 33/68] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:56.764586 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.772836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fcf60e51-b19c-4da0-a290-0efa14fbae83 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.170461 May 09 18:31:56.773406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 36/69] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:56.813197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.813789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.820037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.820487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.821260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.821676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.889540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.897899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42ccaf9c-97c4-4fd1-88cb-fe10c117f016 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.088560 May 09 18:31:56.898463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 34/70] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:57.681706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.683010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.689768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.690222 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.691004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.691460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.757743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:57.765282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bd34c1d6-dbcd-40e3-8737-a118bba43a13 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.090200 May 09 18:31:57.765849 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 37/71] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:57.789707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.790349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.796939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.797373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.798136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.798565 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.916274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.916943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.924571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.925318 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.926643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.927149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.950259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:57.958248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fb7eb69a-4aa0-4fdd-8ec5-3b8bbb3be00b tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.172264 May 09 18:31:57.958700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 35/72] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:57.989725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:57.997853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-092930e7-a768-4bbf-834f-b09accd6ff65 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.086742 May 09 18:31:57.998430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 38/73] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:58.795836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:58.796375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:58.810288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.810735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.811519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.812015 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.893892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:58.902152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f471551b-7e86-47a2-b154-393cf3fdd91b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.121823 May 09 18:31:58.902779 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 36/74] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:58 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:58.976137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:58.976824 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:58.991671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.992420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.993486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.993978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.015692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:59.016348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:59.028375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.029127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.030507 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.030941 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.135730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:59.144065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-471597bd-c5c6-46a7-90ac-133b73509472 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.132915 May 09 18:31:59.144985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 37/75] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:59 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:59.198560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:59.206999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-462cfbe8-bed8-4183-afd2-6636f24e6286 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.235473 May 09 18:31:59.208249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 39/76] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:58 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:59.919295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:59.921419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:59.932818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.938474 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.940327 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.941105 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.049026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:00.057360 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4f525db2-77f9-4054-a608-5e1bc3cfa338 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.141840 May 09 18:32:00.059751 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 38/77] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:31:59 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:00.169524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:00.171799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:00.187935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.194626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.197490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.198672 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.225380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:00.226067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:00.252901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.254934 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.265203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.268601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.320625 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:00.341122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0701069e-4886-4a6c-ae7a-9ee16a187312 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.171382 May 09 18:32:00.341803 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 40/78] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:00 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:00.539607 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:00.562202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1aa1044d-ba93-4d0b-80f3-9026ec324f61 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.341296 May 09 18:32:00.562739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 39/79] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:00 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:01.077409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.078681 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.086760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.087201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.087995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.088425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.174301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.183882 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-18f55283-e604-4656-b687-a1aa0951ca36 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.111163 May 09 18:32:01.185119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 41/80] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:01.360330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.361829 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.369534 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.370140 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.371528 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.372810 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.463178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.475092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-65961238-1615-4172-b6cd-d12a901103cf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.116997 May 09 18:32:01.485319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 40/81] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:01.580396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.580964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.589843 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.590320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.591129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.591568 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.742995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.750786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ccc37501-986c-4355-8b71-ea6219061552 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.174703 May 09 18:32:01.751366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 42/82] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:02.201470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.202093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.208056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.208689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.209674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.210430 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.301176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:02.309537 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4991fffb-b8ac-4d37-9178-e276b5ce0dc8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.112063 May 09 18:32:02.310419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 41/83] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:02.491807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.492565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.498695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.499146 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.499932 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.500388 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.572193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:02.579609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0c4af2e1-f17d-45ef-9edf-818da23a8580 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.091670 May 09 18:32:02.580213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 43/84] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:02.767935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.768574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.775120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.775577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.776532 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.776967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.917268 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:02.926436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3081fd47-42d6-478b-84f7-6f732b420e8d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.162537 May 09 18:32:02.927809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 42/85] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:03.326650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:03.327252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:03.333528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.333978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.334811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.335401 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.409180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:03.413874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c79cfe5e-f5b4-4eb3-8be1-6f38d76c7a3b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.091256 May 09 18:32:03.414497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 44/86] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:03 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:03.597738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:03.598670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:03.605210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.605472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.606248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.606837 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.688329 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:03.697247 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-478f6e98-e1b9-4204-a8df-ec55caf3fd1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1280 microversion: 2.1 time: 0.103866 May 09 18:32:03.698181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 43/87] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:03 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:03.945772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:03.946699 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:03.955703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.956441 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.957361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.957974 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.209085 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:04.217219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5972a18b-8680-455c-a2b0-a9147aef9271 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.275914 May 09 18:32:04.218561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 45/88] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:03 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:04.431314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:04.431933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:04.438612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.449440 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.450447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.451242 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.646507 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:04.683884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-350e3e30-e963-446d-95c4-06fb2c4acd00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1300 microversion: 2.1 time: 0.256599 May 09 18:32:04.689003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 44/89] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:04 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:04.714729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:04.715828 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:04.723421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.723880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.728207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.729249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.024677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:05.036459 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2d525684-ad34-4f88-8765-38141615095c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.322654 May 09 18:32:05.042928 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 46/90] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:04 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:05.236426 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-f666958a-8842-4457-ac19-4fe1de5cfc3b req-58fb14fb-c371-4e2a-91b5-87884c726af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4246c50-6390-4bc7-80e5-1af76bf497d8", "tag": "24ee4c5b-8470-4eee-a206-18696d387c6d"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:05.240259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:05.241431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:05.250302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f666958a-8842-4457-ac19-4fe1de5cfc3b req-58fb14fb-c371-4e2a-91b5-87884c726af0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.250938 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f666958a-8842-4457-ac19-4fe1de5cfc3b req-58fb14fb-c371-4e2a-91b5-87884c726af0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.256302 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.259308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.262852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.264228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.269934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-f666958a-8842-4457-ac19-4fe1de5cfc3b req-58fb14fb-c371-4e2a-91b5-87884c726af0 service nova] Creating event network-changed:24ee4c5b-8470-4eee-a206-18696d387c6d for instance f4246c50-6390-4bc7-80e5-1af76bf497d8 on hv-cinder-83588 May 09 18:32:05.286599 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-f666958a-8842-4457-ac19-4fe1de5cfc3b req-58fb14fb-c371-4e2a-91b5-87884c726af0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053807 May 09 18:32:05.287566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 47/91] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:05.494002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:05.541957 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1b867761-19bd-4bda-980f-ac04c0fdf348 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.310802 May 09 18:32:05.549234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 45/92] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:05 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:05.704262 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:05.705617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:05.718783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.719604 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.725990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.726773 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.052144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.054377 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.066623 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.070961 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.071839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.072309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.097436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.108790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-23682845-425d-4886-9e58-4beabeb71775 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.409103 May 09 18:32:06.112286 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 48/93] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:05 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:06.360078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.371039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9127435f-ad69-428e-ae57-a04860d0e531 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.322592 May 09 18:32:06.373005 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 46/94] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:06.571292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.571292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.587245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.587245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.588821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.590768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.980501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.991869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-792ad159-497d-4533-b0ce-55b61bd8d821 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.428845 May 09 18:32:06.992692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 49/95] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:07.131490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:07.132518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:07.150741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.151721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.155670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.156159 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.390075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:07.390815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:07.397403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.397850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.398642 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.399072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.097918 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:08.107632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1395ce16-f38a-4cad-8a3b-7a0351555152 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.982551 May 09 18:32:08.108835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 47/96] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:07 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:08.174021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:08.179180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-0cd465fa-3a18-4b8a-90c5-2fb25e227808 req-eb1e1ab5-277b-4aa4-bb90-2903d3180cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe2046a-655a-4a12-ad29-1427fa1d4f9a", "tag": "8cb1941d-8c8f-4b27-9f9d-5b70f843c15b"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:08.184745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-381b18af-d191-47fa-8ad0-e082019daf64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.798621 May 09 18:32:08.185336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 50/97] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:07 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:08.192044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0cd465fa-3a18-4b8a-90c5-2fb25e227808 req-eb1e1ab5-277b-4aa4-bb90-2903d3180cbd service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.192753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0cd465fa-3a18-4b8a-90c5-2fb25e227808 req-eb1e1ab5-277b-4aa4-bb90-2903d3180cbd service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.199991 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:08.200629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:08.208212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.208655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.209559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.209989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.219480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-0cd465fa-3a18-4b8a-90c5-2fb25e227808 req-eb1e1ab5-277b-4aa4-bb90-2903d3180cbd service nova] Creating event network-changed:8cb1941d-8c8f-4b27-9f9d-5b70f843c15b for instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a on hv-cinder-83588 May 09 18:32:08.220083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0cd465fa-3a18-4b8a-90c5-2fb25e227808 req-eb1e1ab5-277b-4aa4-bb90-2903d3180cbd service nova] Acquired lock "compute-rpcapi-router" {{(pid=118350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 18:32:08.221262 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.221913 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.222849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.223448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.234923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.compute.rpcapi [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 18:32:08.237750 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] Releasing lock "compute-rpcapi-router" {{(pid=118350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 18:32:08.264371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-55e98872-fe4a-494e-aa7c-abde0ec8e86a None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153902 May 09 18:32:08.264994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 48/98] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:08.302546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-eb48fc6f-bb90-471f-b2c7-189537ec4fe2 req-efb2b7a6-1340-42b0-bd79-ebf734617b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636e0866-b43c-484b-9c6e-4a9bbf99bc64", "tag": "3fab78a6-4e33-406a-b544-8fdb086015c3"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:08.312560 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-eb48fc6f-bb90-471f-b2c7-189537ec4fe2 req-efb2b7a6-1340-42b0-bd79-ebf734617b09 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.313227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-eb48fc6f-bb90-471f-b2c7-189537ec4fe2 req-efb2b7a6-1340-42b0-bd79-ebf734617b09 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.325951 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-eb48fc6f-bb90-471f-b2c7-189537ec4fe2 req-efb2b7a6-1340-42b0-bd79-ebf734617b09 service nova] Creating event network-changed:3fab78a6-4e33-406a-b544-8fdb086015c3 for instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 on hv-cinder-83588 May 09 18:32:08.331200 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-eb48fc6f-bb90-471f-b2c7-189537ec4fe2 req-efb2b7a6-1340-42b0-bd79-ebf734617b09 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038745 May 09 18:32:08.331809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 49/99] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:08.385047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:08.393414 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-471d0b22-33c1-49ce-ab5c-cc4ca49dd109 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.203379 May 09 18:32:08.394915 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 51/100] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:08 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:09.128971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:09.128971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:09.135786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.137003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.137181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.138574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.202393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:09.203160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:09.209484 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.210030 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.210902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.211424 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.367124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:09.389801 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-88d41184-bf6f-484a-a6c0-e3d7b0307df9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.267648 May 09 18:32:09.390690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 50/101] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:09 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:09.401687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:09.410958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-42fb942d-9779-4370-9392-8037e3efd8d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.212583 May 09 18:32:09.418378 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 52/102] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:09 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:09.420651 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:09.421393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:09.428735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.429308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.430261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.430702 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.572611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:09.581375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d8f39f7a-a8c2-4f45-91fd-6f46cdb37dfd tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.168301 May 09 18:32:09.582257 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 51/103] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:09 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:10.407572 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:10.408206 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:10.414353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.415075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.416170 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.416811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.430391 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:10.431935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:10.439836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.440538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.441747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.442616 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.652971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:10.666929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:10.672170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-efe76ac5-69d6-47f6-b3d7-fc54253b5215 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.246836 May 09 18:32:10.672745 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 52/104] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:10 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:10.677244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-be7cca00-28b2-4168-a1f5-bf86ceba4cf2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.273996 May 09 18:32:10.679594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 53/105] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:10 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:10.683371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:10.683984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:10.690252 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.690700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.691482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.691878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.008188 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:11.016086 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-43b31a7d-cc4b-4e3c-9049-29fa2ebaa0fb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.336682 May 09 18:32:11.016973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 53/106] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:10 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:11.694584 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:11.695202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:11.697098 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:11.697853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:11.705884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.709800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.710475 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.711258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.711695 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.716316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.717398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.717856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.051816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.062851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a17e4f08-c55c-43d9-a3f0-2c53f6b57c9e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.372337 May 09 18:32:12.064503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 54/107] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:11 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:12.071436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:12.077875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:12.085734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.086436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.088122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.088797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.095468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.111191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-dcee56b3-a3d6-4298-b711-b866555ed81b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.426207 May 09 18:32:12.115487 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 54/108] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:11 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:12.263349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.272741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-faa7062d-b6a7-41b8-ac65-464e8d23853f tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.206450 May 09 18:32:12.274057 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 55/109] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:12 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:13.083467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.084408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.094461 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.095419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.097087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.098279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.131771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.132538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.143875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.149559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.153862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.156127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.596041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:13.615765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b2ef1554-7de6-4656-86d3-593789c20f4e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.488833 May 09 18:32:13.618113 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 56/110] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:13.627731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.629054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.635026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:13.651797 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4ba77544-7938-4707-865c-75f8487987b1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.573153 May 09 18:32:13.654290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 55/111] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:13.655750 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.656688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.657733 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.658363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.013445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-5fd40675-5712-45c9-a082-3fd122680ae7 req-638c91cd-3ee1-41f8-aeac-2ac83945e4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558654f6-195d-477d-a28d-ca674785bad6", "name": "network-vif-plugged", "status": "completed", "tag": "432f32a7-4190-4b3e-af78-a0f95c8aa2c9"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:14.027552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-5fd40675-5712-45c9-a082-3fd122680ae7 req-638c91cd-3ee1-41f8-aeac-2ac83945e4c4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.028249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-5fd40675-5712-45c9-a082-3fd122680ae7 req-638c91cd-3ee1-41f8-aeac-2ac83945e4c4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.057463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-5fd40675-5712-45c9-a082-3fd122680ae7 req-638c91cd-3ee1-41f8-aeac-2ac83945e4c4 service nova] Creating event network-vif-plugged:432f32a7-4190-4b3e-af78-a0f95c8aa2c9 for instance 558654f6-195d-477d-a28d-ca674785bad6 on hv-cinder-83588 May 09 18:32:14.069398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-5fd40675-5712-45c9-a082-3fd122680ae7 req-638c91cd-3ee1-41f8-aeac-2ac83945e4c4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171356 May 09 18:32:14.071762 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 56/112] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:14.101063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.108920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c6f5c55d-c62e-481a-b246-8d9b39d5066a tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.487916 May 09 18:32:14.109692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 57/113] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:14.635547 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:14.636969 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:14.649085 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.649864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.650877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.655821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.670479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:14.671245 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:14.680144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.681447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.683069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.683929 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.886997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.900282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1b07864d-11ea-4029-bd7a-84c9ddf427de tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.269190 May 09 18:32:14.901492 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 57/114] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:14 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:14.902516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.917518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-20841e7f-2505-4e7d-b0ce-6de613ec7f1d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.251114 May 09 18:32:14.919153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 58/115] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:14 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:15.126081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.126830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.135081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.137494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.139525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.141230 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.413718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:15.424587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7d6400b7-2125-487e-b372-97c9062fd5b1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.302506 May 09 18:32:15.425732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 58/116] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:15.924731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.927677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.935357 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.935828 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.937676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.943324 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.947652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.950714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.951294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.951903 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.953633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.953633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.190398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:16.195813 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:16.212528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-21fd06c2-10b1-49fa-9f65-a9b9c3a65bd1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.281051 May 09 18:32:16.213744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-141da2d2-54df-4166-8488-dcf131c67cd5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.296960 May 09 18:32:16.223992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 59/117] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:16.224784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 59/118] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:16.229607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-940a2c10-61c3-4ed9-bc4d-317b35fa9012 req-9d4defc3-2640-48b6-a883-38acb85dae38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4246c50-6390-4bc7-80e5-1af76bf497d8", "name": "network-vif-plugged", "status": "completed", "tag": "24ee4c5b-8470-4eee-a206-18696d387c6d"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:16.239482 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-940a2c10-61c3-4ed9-bc4d-317b35fa9012 req-9d4defc3-2640-48b6-a883-38acb85dae38 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.240244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-940a2c10-61c3-4ed9-bc4d-317b35fa9012 req-9d4defc3-2640-48b6-a883-38acb85dae38 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.256526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-940a2c10-61c3-4ed9-bc4d-317b35fa9012 req-9d4defc3-2640-48b6-a883-38acb85dae38 service nova] Creating event network-vif-plugged:24ee4c5b-8470-4eee-a206-18696d387c6d for instance f4246c50-6390-4bc7-80e5-1af76bf497d8 on hv-cinder-83588 May 09 18:32:16.263102 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-940a2c10-61c3-4ed9-bc4d-317b35fa9012 req-9d4defc3-2640-48b6-a883-38acb85dae38 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037280 May 09 18:32:16.264785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 60/119] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:16.444656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:16.445420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:16.453942 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.454655 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.455972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.456550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.651193 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:16.660397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-30d1d5fc-e84b-453f-b984-453ea1dddd44 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.222219 May 09 18:32:16.661378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 60/120] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:16 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:17.232229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:17.235633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:17.240818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:17.241455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:17.244019 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.244659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.245499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.245937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.248462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.249113 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.250068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.250558 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.458759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:17.467279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-da0ce136-2635-46dc-b88a-31a0f7881da8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.240071 May 09 18:32:17.480444 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 61/121] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:17 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:17.507252 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:17.516090 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8c9feb04-1ca0-49ce-b71a-50cfbff1514a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.279821 May 09 18:32:17.516924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 61/122] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:17 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:17.678088 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:17.679659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:17.689654 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.691925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.692968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.694433 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.034172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:18.042267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f320a11e-64d4-455a-8cf0-9e42325a8d52 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.368249 May 09 18:32:18.042773 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 62/123] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:17 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:18.490185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:18.491076 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:18.498476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.499260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.500350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.501019 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.535095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:18.536709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:18.549437 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.551175 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.552930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.553524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.794454 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:18.805145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-604fee0f-7a6b-4446-86a9-3909f16de47f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.319635 May 09 18:32:18.809876 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 62/124] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:18 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:18.982138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:18.998009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fe69c3c6-8157-4093-8757-7219c7c7f7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.468258 May 09 18:32:18.999706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 63/125] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:18 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:19.061196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:19.062337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:19.076797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:19.077993 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.079084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:19.079981 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.252581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:19.258075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-06143dc7-e472-4a2e-9492-5a74f6b1d6bc tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1315 microversion: 2.1 time: 0.202433 May 09 18:32:19.261092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 63/126] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:19 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:19.828962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:19.829640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:19.837293 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:19.837749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.838534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:19.841145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.993936 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.002358 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b4a96d70-da40-4c86-ae46-ce7b0ff36db9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.177897 May 09 18:32:20.002914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 64/127] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:19 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:20.017216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:20.017910 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:20.024130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.024773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.025665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.026247 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.199529 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.209974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c3109aa4-2a12-43f3-a411-21e0816f1162 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.195159 May 09 18:32:20.209974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 64/128] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:20 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:20.281893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:20.282561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:20.291193 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-2e544fcf-d17d-4901-956f-f0569cc9a1f5 req-bd3539c5-a26b-44b7-a498-cbf7d8b6e75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe2046a-655a-4a12-ad29-1427fa1d4f9a", "name": "network-vif-plugged", "status": "completed", "tag": "8cb1941d-8c8f-4b27-9f9d-5b70f843c15b"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:20.311894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-2e544fcf-d17d-4901-956f-f0569cc9a1f5 req-bd3539c5-a26b-44b7-a498-cbf7d8b6e75f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.312555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-2e544fcf-d17d-4901-956f-f0569cc9a1f5 req-bd3539c5-a26b-44b7-a498-cbf7d8b6e75f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.316239 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.317205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.318561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.319629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.358886 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-2e544fcf-d17d-4901-956f-f0569cc9a1f5 req-bd3539c5-a26b-44b7-a498-cbf7d8b6e75f service nova] Creating event network-vif-plugged:8cb1941d-8c8f-4b27-9f9d-5b70f843c15b for instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a on hv-cinder-83588 May 09 18:32:20.374098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-2e544fcf-d17d-4901-956f-f0569cc9a1f5 req-bd3539c5-a26b-44b7-a498-cbf7d8b6e75f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080031 May 09 18:32:20.374098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 65/129] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:20.567540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.576998 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-76125aca-bb06-4d1b-b84a-f88ad15a3e06 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1502 microversion: 2.1 time: 0.301909 May 09 18:32:20.578016 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 65/130] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:20 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:21.019443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:21.020194 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:21.031185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.031643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.032482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.032915 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.195318 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:21.217233 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ec1ed84c-c498-4491-aaae-70efb2f34a3b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.202179 May 09 18:32:21.224589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:21.226017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:21.227511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 66/131] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:21 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:21.235231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.236276 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.237227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.238035 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.416049 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:21.424106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e0e4c246-a2f8-465c-99bc-5d6e43f3f82f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1368 microversion: 2.1 time: 0.203670 May 09 18:32:21.429196 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 66/132] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:21 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:22.235110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.235743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.240261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d9ae96a-c925-413f-b959-b054481fbb71"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:22.241416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.249389 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.251271 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.251723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.252539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.252975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.253607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.254844 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.255349 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.448303 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:22.456060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0f18d50c-e24a-4e9c-8bfc-c38381c461c4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.225294 May 09 18:32:22.456778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 67/133] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:22.474513 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-6a6268c5-ceea-46df-ae67-5c48c2114bbf req-4d37333f-bb11-41ac-903a-c4af7a7bc936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636e0866-b43c-484b-9c6e-4a9bbf99bc64", "name": "network-vif-plugged", "status": "completed", "tag": "3fab78a6-4e33-406a-b544-8fdb086015c3"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:22.503012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6a6268c5-ceea-46df-ae67-5c48c2114bbf req-4d37333f-bb11-41ac-903a-c4af7a7bc936 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.503894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6a6268c5-ceea-46df-ae67-5c48c2114bbf req-4d37333f-bb11-41ac-903a-c4af7a7bc936 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.517917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-6a6268c5-ceea-46df-ae67-5c48c2114bbf req-4d37333f-bb11-41ac-903a-c4af7a7bc936 service nova] Creating event network-vif-plugged:3fab78a6-4e33-406a-b544-8fdb086015c3 for instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 on hv-cinder-83588 May 09 18:32:22.523511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-6a6268c5-ceea-46df-ae67-5c48c2114bbf req-4d37333f-bb11-41ac-903a-c4af7a7bc936 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065236 May 09 18:32:22.525522 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 68/134] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:22.531196 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.531885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.539077 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.539525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.540355 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.540803 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.719985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:22.729800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7292519c-ae59-4dd2-94c2-bd193b4044ec tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1558 microversion: 2.1 time: 0.202749 May 09 18:32:22.730393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 69/135] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:22.746881 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.747643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.753826 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.754921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.755776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.756241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.779182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0bde1085-3e78-4522-a02c-23a540c14c78 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "POST /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552226 May 09 18:32:22.780740 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 67/136] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:32:22 2022] POST /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:22.902184 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7d8fa152-1b19-4634-99b0-3dca8655608d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159038 May 09 18:32:22.902813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 70/137] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:23.479889 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:23.490051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:23.498333 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.499043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.500197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.500858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.688080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:23.699043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4d2ea4ca-81af-44c4-8c18-6411942e7860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1322 microversion: 2.1 time: 0.223537 May 09 18:32:23.701655 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 68/138] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:23 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:24.661537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-e7a7ef21-7788-423f-ab29-fbc2dac9e648 req-22b6ee60-6c0c-4927-a608-d65ad3a73c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe2046a-655a-4a12-ad29-1427fa1d4f9a", "tag": "8cb1941d-8c8f-4b27-9f9d-5b70f843c15b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:24.672238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-e7a7ef21-7788-423f-ab29-fbc2dac9e648 req-22b6ee60-6c0c-4927-a608-d65ad3a73c7e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.673001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-e7a7ef21-7788-423f-ab29-fbc2dac9e648 req-22b6ee60-6c0c-4927-a608-d65ad3a73c7e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.690198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-e7a7ef21-7788-423f-ab29-fbc2dac9e648 req-22b6ee60-6c0c-4927-a608-d65ad3a73c7e service nova] Creating event network-changed:8cb1941d-8c8f-4b27-9f9d-5b70f843c15b for instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a on hv-cinder-83588 May 09 18:32:24.696063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-e7a7ef21-7788-423f-ab29-fbc2dac9e648 req-22b6ee60-6c0c-4927-a608-d65ad3a73c7e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041324 May 09 18:32:24.697371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 71/139] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:24.718797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:24.720164 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:24.734281 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.736544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.740491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.741174 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.996317 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.015550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3903f8a6-8d96-4a4c-914a-e39a816c0b64 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1517 microversion: 2.1 time: 0.301695 May 09 18:32:25.023910 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 69/140] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:24 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:25.045319 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:25.046436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.060826 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.061288 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.062140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.062704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.109986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lazy-loading 'flavor' on Instance uuid 636e0866-b43c-484b-9c6e-4a9bbf99bc64 {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:32:25.408677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b2c2bd3c-38ee-4498-8a5b-7cced83a7110 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64/action" status: 200 len: 32 microversion: 2.1 time: 0.368305 May 09 18:32:25.410709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 72/141] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:32:25 2022] POST /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:32:25.421025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:25.421923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.434321 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.435938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.437020 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.437591 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.882408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.892229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-766c30f7-81c3-4902-84ef-4a3e9c0b2755 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.475542 May 09 18:32:25.894234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 70/142] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:25 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:26.910676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:26.911520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:26.933318 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.933781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.934572 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.935171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.187112 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.200980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1f5e5686-ffd9-45b7-99b3-4c053a23a65a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.291471 May 09 18:32:27.201616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 73/143] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:26 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:28.234222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:28.235075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:28.242106 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.242543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.243330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.243913 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.413294 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:28.421504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0863354a-ac73-4aec-be1d-d08d29ed86d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.206419 May 09 18:32:28.422308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 71/144] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:28 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:29.439679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:29.441449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:29.449108 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.449978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.451859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.453726 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.605462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.621451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7e49e0ed-42ea-4190-89b4-139fe8797cbc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.186305 May 09 18:32:29.634575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 74/145] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:29 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:30.640848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:30.641606 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:30.679786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.680286 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.681373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.683661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.962727 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.975277 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-bd630b50-ec1e-454c-b51b-51a35f4c0bda tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.337731 May 09 18:32:30.976291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 72/146] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:30 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:31.995304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:31.996313 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:32.014501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:32.015028 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:32.020462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.021017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.025560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.030054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.030459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.031261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.031694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.032396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.100901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:32:32.290501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.300408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ca4d27a6-f0c8-49b7-a04c-6768e68c0502 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.309479 May 09 18:32:32.301144 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 75/147] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:31 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:32.311017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-aa54e031-d90e-44cd-8a83-f9b5f39622a7 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "DELETE /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 204 len: 0 microversion: 2.1 time: 0.296882 May 09 18:32:32.312809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 73/148] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:32:32 2022] DELETE /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:32:32.321071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:32.321772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:32.337129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.338060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.339237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.339882 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.516765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.528861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-49a81a21-2ca7-40b3-833c-27f2555b204d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1554 microversion: 2.1 time: 0.212126 May 09 18:32:32.539715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 76/149] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:32 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.319278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.320100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.336036 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.337756 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.340583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.341350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.546790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.547313 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.563165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.563995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.564760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.565254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.711398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.723009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-691f9bf5-2a2e-4a13-973a-38b16cd381f3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.408624 May 09 18:32:33.723680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 74/150] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.805261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.813224 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b334714c-fd59-47b0-98ff-a48b5c7065ff tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1554 microversion: 2.1 time: 0.270325 May 09 18:32:33.814978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 77/151] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:34.741176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:34.742691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:34.751369 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.752249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.753368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.754013 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.830527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:34.831080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:34.837463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.844704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.845732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.846310 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.125153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.136767 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8ea1b158-9c81-49b3-882a-17c27e84a1d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.399689 May 09 18:32:35.141150 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 75/152] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:34 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:35.182656 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.211013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-994be49c-e3a4-471a-aaeb-c7f4e7525af1 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1554 microversion: 2.1 time: 0.383752 May 09 18:32:35.214639 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 78/153] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:34 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1554 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:36.157867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:36.158484 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:36.165802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.166254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.167035 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.167497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.232860 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:36.233508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:36.243560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.244005 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.245537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.246128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.567309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:36.577133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b8af17b3-12cc-4973-9695-e5822b6a1fea tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.423364 May 09 18:32:36.577905 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 76/154] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:36 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:36.656707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:36.665653 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d72fedb0-8102-42de-9308-e4d4058697ea tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1554 microversion: 2.1 time: 0.438203 May 09 18:32:36.666257 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 79/155] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:36 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1554 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:37.146126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-d43d8e1e-0ae8-4de1-94b0-d006fcd49379 req-00d0b287-313a-4a46-9a97-d58da09c48bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558654f6-195d-477d-a28d-ca674785bad6", "name": "network-vif-deleted", "tag": "432f32a7-4190-4b3e-af78-a0f95c8aa2c9"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:37.154351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-d43d8e1e-0ae8-4de1-94b0-d006fcd49379 req-00d0b287-313a-4a46-9a97-d58da09c48bb service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.154787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-d43d8e1e-0ae8-4de1-94b0-d006fcd49379 req-00d0b287-313a-4a46-9a97-d58da09c48bb service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.165893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-d43d8e1e-0ae8-4de1-94b0-d006fcd49379 req-00d0b287-313a-4a46-9a97-d58da09c48bb service nova] Creating event network-vif-deleted:432f32a7-4190-4b3e-af78-a0f95c8aa2c9 for instance 558654f6-195d-477d-a28d-ca674785bad6 on hv-cinder-83588 May 09 18:32:37.170940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-d43d8e1e-0ae8-4de1-94b0-d006fcd49379 req-00d0b287-313a-4a46-9a97-d58da09c48bb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028583 May 09 18:32:37.171514 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 77/156] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:37.600306 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:37.602524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:37.623884 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.624187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.624981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.625413 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.684075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:37.685146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:37.694631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.695203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.696035 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.698038 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.841208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.851529 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ce1c9440-904a-44f2-bfcb-6e7c62421132 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1346 microversion: 2.1 time: 0.172062 May 09 18:32:37.852856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 78/157] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:37 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:37.919743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.928054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-25d3c256-7c29-41e1-9ebf-f038fe6916a8 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.336872 May 09 18:32:37.929221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 80/158] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:37 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:38.808131 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-812947691", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "networks": [{"uuid": "5eed2f69-9c58-465b-badd-168396918d29"}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:38.869535 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:38.870232 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:38.881744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:38.882266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:38.883129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:38.883558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:38.919443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] validate_networks() for [('5eed2f69-9c58-465b-badd-168396918d29', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:32:39.011127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.015630 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.016717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lazy-loading 'fault' on Instance uuid 558654f6-195d-477d-a28d-ca674785bad6 {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:32:39.133224 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5240a913f80342b981c1c52ebe90ca1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4643e347d54eef897b2b9c9b14f804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.144785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8d8aefce-b3be-4003-8f8c-681a515a976d tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 200 len: 1305 microversion: 2.1 time: 0.279366 May 09 18:32:39.145972 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 81/159] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:38 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:39.152910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:39.154085 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:39.160861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.161649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.163089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.163775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.434241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.442026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-15e95a88-c12c-453a-8fcd-2292dbc00c2c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.294381 May 09 18:32:39.443007 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 82/160] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:39 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:39.504863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:32:39.505353 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:32:39.505828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:32:39.506232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:32:39.506638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:32:39.515507 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.515995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.516790 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.517224 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.534248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Getting quotas for project 3f4a24fbe14b4a39a9e756af7cd28d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:32:39.538280 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Getting quotas for user ba14881149754c6bb3bfaa17300ff46e and project 3f4a24fbe14b4a39a9e756af7cd28d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:32:39.549177 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:32:39.551500 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:32:39.603045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-14a5bd48-376f-4359-b053-bd8598a28101 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799723 May 09 18:32:39.603977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 79/161] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:32:39.613879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a582a037-5d22-4991-aad2-aab2672be217 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:39.622213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a582a037-5d22-4991-aad2-aab2672be217 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:39.700316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a582a037-5d22-4991-aad2-aab2672be217 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.716348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a582a037-5d22-4991-aad2-aab2672be217 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1213 microversion: 2.1 time: 0.097200 May 09 18:32:39.716348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 83/162] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:39 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:40.163332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:40.164681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:40.170086 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.170546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.171308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.171762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.186255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] HTTP exception thrown: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Request method failure captured: May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 HTTP/1.1 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4ASg4rw9qyMzGmbhCH_xBvAc-U11Sgs7YByYXwd0m6RXtb_epkM8bz1fbMULeH-KXkX4LvKsiooPv1t3nMPSqOdbN0gl5JRfmZ3wDCBYxbLPxObIjhsun_ypwJvEOM5SE7Qn2P6cmsPCjilAMpECqSNIS6XncFhMzWjw_lUZwTGsY May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:32:40.191071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4643e347d54eef897b2b9c9b14f804"}]}] May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 5240a913f80342b981c1c52ebe90ca1f May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.192415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '558654f6-195d-477d-a28d-ca674785bad6'} May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:40.193148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.194278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:40.195270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Returning 404 to user: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:40.195270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ec75f347-5a00-4d8a-a5eb-99c51a3c0ac0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 404 len: 111 microversion: 2.1 time: 0.033810 May 09 18:32:40.195270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 80/163] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:40 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:40.298021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:40.299065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:40.305060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.305504 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.306265 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.306691 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.319378 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] HTTP exception thrown: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Request method failure captured: May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6/os-volume_attachments HTTP/1.1 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4ASg4rw9qyMzGmbhCH_xBvAc-U11Sgs7YByYXwd0m6RXtb_epkM8bz1fbMULeH-KXkX4LvKsiooPv1t3nMPSqOdbN0gl5JRfmZ3wDCBYxbLPxObIjhsun_ypwJvEOM5SE7Qn2P6cmsPCjilAMpECqSNIS6XncFhMzWjw_lUZwTGsY May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:32:40.323837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4643e347d54eef897b2b9c9b14f804"}]}] May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 5240a913f80342b981c1c52ebe90ca1f May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.325333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': '558654f6-195d-477d-a28d-ca674785bad6'} May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:40.326091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:40.327138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:40.328215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Returning 404 to user: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:40.328215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-651ad821-3bfc-4950-8048-5e904bb22d45 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031608 May 09 18:32:40.328215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 84/164] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:32:40 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:40.459923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:40.460787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:40.468061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.468586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.469432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.470060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.652392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:40.660340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a6ff462b-f07a-4e23-bd3e-562c54832081 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.204355 May 09 18:32:40.660955 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 81/165] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:40 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:40.724478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:40.725229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:40.731240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.731679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.733075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.733509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.798316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:40.806018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3d4905e1-2fb0-47e6-a0fc-d9bfced66323 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1217 microversion: 2.1 time: 0.085594 May 09 18:32:40.806600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 85/166] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:40 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:41.678423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:41.679302 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:41.686085 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.686636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:41.687412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.687844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:41.822631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:41.823275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:41.829800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.830329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:41.831575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.832221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:41.857288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:41.865885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-84425fee-7399-43eb-aa96-49eabdc3b1a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.191751 May 09 18:32:41.866459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 82/167] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:41 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:41.909223 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:41.916750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a7d8baba-a474-4b47-bed2-df9588060f15 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1209 microversion: 2.1 time: 0.098078 May 09 18:32:41.917353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 86/168] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:41 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:42.883108 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:42.883809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:42.891041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:42.891644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:42.893454 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:42.893904 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:42.934778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:42.935627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:42.942091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:42.942660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:42.943651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:42.944371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.056783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:43.069771 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-322826e1-4fee-44ee-8d86-f845e142a39b tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1271 microversion: 2.1 time: 0.138554 May 09 18:32:43.071038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 87/169] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:42 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:43.161684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:43.170413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-60262b48-dee2-426e-bd39-472cb5993c5a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.291770 May 09 18:32:43.178747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 83/170] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:42 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:43.646197 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:43.646773 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:43.656283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.656283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.656283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.656283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.671546 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] HTTP exception thrown: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Request method failure captured: May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 HTTP/1.1 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4ASg4rw9qyMzGmbhCH_xBvAc-U11Sgs7YByYXwd0m6RXtb_epkM8bz1fbMULeH-KXkX4LvKsiooPv1t3nMPSqOdbN0gl5JRfmZ3wDCBYxbLPxObIjhsun_ypwJvEOM5SE7Qn2P6cmsPCjilAMpECqSNIS6XncFhMzWjw_lUZwTGsY May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:32:43.674059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4643e347d54eef897b2b9c9b14f804"}]}] May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 5240a913f80342b981c1c52ebe90ca1f May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.675562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '558654f6-195d-477d-a28d-ca674785bad6'} May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:43.676671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.678192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:32:43.679613 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Returning 404 to user: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:43.680280 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7126002d-ae1b-49de-bf82-294de8fcf1d0 tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "DELETE /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 404 len: 111 microversion: 2.1 time: 0.037962 May 09 18:32:43.681210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 88/171] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:32:43 2022] DELETE /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:43.689153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:43.689870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] [instance: 558654f6-195d-477d-a28d-ca674785bad6] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:43.696136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.697451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.698375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.698892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.712913 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] HTTP exception thrown: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Request method failure captured: May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 HTTP/1.1 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4ASg4rw9qyMzGmbhCH_xBvAc-U11Sgs7YByYXwd0m6RXtb_epkM8bz1fbMULeH-KXkX4LvKsiooPv1t3nMPSqOdbN0gl5JRfmZ3wDCBYxbLPxObIjhsun_ypwJvEOM5SE7Qn2P6cmsPCjilAMpECqSNIS6XncFhMzWjw_lUZwTGsY May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:32:43.714588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4643e347d54eef897b2b9c9b14f804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4643e347d54eef897b2b9c9b14f804"}]}] May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 3f4643e347d54eef897b2b9c9b14f804 May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1623386167 May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 5240a913f80342b981c1c52ebe90ca1f May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-DeleteServersTestJSON-1623386167-project May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.716178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '558654f6-195d-477d-a28d-ca674785bad6'} May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:43.716972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. May 09 18:32:43.718109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:43.719092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] Returning 404 to user: Instance 558654f6-195d-477d-a28d-ca674785bad6 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:43.719092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-36e2345a-0f23-46d1-afcf-f9bb29315dfb tempest-DeleteServersTestJSON-1623386167 tempest-DeleteServersTestJSON-1623386167-project] 10.222.0.35 "GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6" status: 404 len: 111 microversion: 2.1 time: 0.032257 May 09 18:32:43.719673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 84/172] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:43 2022] GET /compute/v2.1/servers/558654f6-195d-477d-a28d-ca674785bad6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:44.089110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:44.089788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:44.095815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.096620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.097592 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.098116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.188690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:44.189608 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:44.197798 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.198855 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.199962 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.200545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.532333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:44.542369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-eac955ea-11e1-44e0-bb8d-99530bbfc28d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.456898 May 09 18:32:44.542958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 89/173] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:44 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:44.634067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:44.642581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6c6a6ac1-80e9-4d20-84c4-f9a4d12e2537 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.458009 May 09 18:32:44.643123 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 85/174] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:44 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:45.564558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:45.565198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:45.571606 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.572047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.572823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.573455 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.662596 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:45.664175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:45.671082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.672113 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.672903 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.673358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.823559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:45.832069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-657a2d17-bbcd-4d73-897f-94a0dd826f88 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.271372 May 09 18:32:45.834266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 90/175] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:45 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:45.935564 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:45.946886 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fef2b744-37f1-4453-b6a2-e7f31a7fda12 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.288873 May 09 18:32:45.947483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 86/176] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:45 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:45.949433 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ac4ba8eb-b702-4221-bfe4-720c57b30529 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Action: 'create', calling method: .version_select at 0x7fe8badd3a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1367300198", "metadata": {"Type": "work"}}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:46.282357 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-f8b57a53-004f-4290-9586-44e35e866cae req-6d5a5103-89c1-45b9-a08f-f3847ef40d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4cc4de-538a-4644-8de1-32d35fa56964", "tag": "d8f6bbd0-bda3-43f3-a63c-47d0f6931525"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:46.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ac4ba8eb-b702-4221-bfe4-720c57b30529 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.452384 May 09 18:32:46.287864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 91/177] 10.222.0.35 () {60 vars in 1155 bytes} [Mon May 9 18:32:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 18:32:46.295849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-f8b57a53-004f-4290-9586-44e35e866cae req-6d5a5103-89c1-45b9-a08f-f3847ef40d90 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.298278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-f8b57a53-004f-4290-9586-44e35e866cae req-6d5a5103-89c1-45b9-a08f-f3847ef40d90 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.299722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-352266dc-f59c-45ca-8949-9201ee6e5ad2 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bad80940>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:46.364132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-352266dc-f59c-45ca-8949-9201ee6e5ad2 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 353 microversion: 2.1 time: 0.069418 May 09 18:32:46.365622 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 92/178] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:46 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:46.466836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-f8b57a53-004f-4290-9586-44e35e866cae req-6d5a5103-89c1-45b9-a08f-f3847ef40d90 service nova] Creating event network-changed:d8f6bbd0-bda3-43f3-a63c-47d0f6931525 for instance 8e4cc4de-538a-4644-8de1-32d35fa56964 on hv-cinder-83588 May 09 18:32:46.476579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-f8b57a53-004f-4290-9586-44e35e866cae req-6d5a5103-89c1-45b9-a08f-f3847ef40d90 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199592 May 09 18:32:46.477369 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 87/179] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:46.848825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:46.849573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:46.857902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.858345 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.859108 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.859540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.965221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:46.965988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:46.972653 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.973118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.974136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.974489 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:47.000473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:47.008807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e21e5b0e-309a-4782-b81f-ed0cfe9b851a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.163852 May 09 18:32:47.009479 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 93/180] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:46 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:47.109620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:47.117621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-97aad2f9-922a-4d04-ac67-66fdcc8a260d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.157659 May 09 18:32:47.118232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 88/181] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:46 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:47.378189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-95376bf0-9a9d-46ca-a769-fc32d1b9d6f2 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bad80b80>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:47.432934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-95376bf0-9a9d-46ca-a769-fc32d1b9d6f2 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 354 microversion: 2.1 time: 0.058544 May 09 18:32:47.433256 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 94/182] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:47 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:47.444390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-424ac2bb-6eae-4176-8790-6ff49bf77926 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bae3ce50>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:47.502058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-424ac2bb-6eae-4176-8790-6ff49bf77926 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 354 microversion: 2.1 time: 0.061103 May 09 18:32:47.502953 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 89/183] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:47 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:47.519642 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-77a27736-95a8-4ee9-a3e4-d1d15318e0b6 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bae2fd30>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:47.585175 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-77a27736-95a8-4ee9-a3e4-d1d15318e0b6 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 202 len: 0 microversion: 2.1 time: 0.069428 May 09 18:32:47.585757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 95/184] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:32:47 2022] DELETE /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:32:47.594816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e103e226-aa02-4e4b-a870-b90044267ce7 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bad185e0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:47.641890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e103e226-aa02-4e4b-a870-b90044267ce7 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 353 microversion: 2.1 time: 0.050779 May 09 18:32:47.642689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 90/185] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:47 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:48.027409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:48.028045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:48.035223 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.035665 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:48.036494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.036977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:48.136316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:48.137033 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:48.143694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.144192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:48.144964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.145419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:48.170563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:48.178359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2b6c9c8f-0250-4cba-8605-d1b4f9e11f2f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.154946 May 09 18:32:48.178903 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 96/186] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:48 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:48.283282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:48.291179 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a42cba7d-2292-48c4-ad55-5c6ebf954e2e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.159731 May 09 18:32:48.291743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 91/187] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:48 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:48.654674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f44ebb51-dac8-479b-b400-62f98908df4a tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8badd3040>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:48.701605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f44ebb51-dac8-479b-b400-62f98908df4a tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 353 microversion: 2.1 time: 0.051244 May 09 18:32:48.702154 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 97/188] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:48 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:49.195238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:49.195854 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:49.202536 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:49.202987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:49.203764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:49.204235 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:49.308791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:49.310213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:49.319292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:49.320002 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:49.320772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:49.321210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:49.344490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:49.352296 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-981db434-0f96-41c6-8bb3-e82dbf3c2602 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.161182 May 09 18:32:49.353164 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 92/189] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:49 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:49.476692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:49.484781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-950c3be7-3dce-4b37-a959-67a9123a8c25 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.180253 May 09 18:32:49.496555 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 98/190] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:49 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:49.715128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6c99efc0-639d-4f02-9112-f913b364d7f7 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8baeaa550>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:49.769497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6c99efc0-639d-4f02-9112-f913b364d7f7 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 353 microversion: 2.1 time: 0.058659 May 09 18:32:49.770082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 93/191] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:49 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:50.370050 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:50.370433 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:50.377498 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.377955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.378716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.379149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.505178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:50.505793 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:50.512111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.512555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.513523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.516192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.561064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:50.569019 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1213c422-5de3-4367-90d5-987d2503d0fc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.203229 May 09 18:32:50.569597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 99/192] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:50 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:50.675938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:50.683763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-05fd1a23-01a8-4cc9-9130-987d5442b25f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.182994 May 09 18:32:50.684410 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 94/193] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:50 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:50.782916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-874b156d-63f4-4db8-9943-e493d0248cf0 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bad8f790>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:50.834857 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-874b156d-63f4-4db8-9943-e493d0248cf0 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 200 len: 353 microversion: 2.1 time: 0.056255 May 09 18:32:50.835443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 100/194] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:50 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:51.589040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:51.589965 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:51.599285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.599979 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.601205 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.602549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.701038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:51.703271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:51.716427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.717352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.718447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.719240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.862587 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:51.870798 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1d78729f-b875-462b-9a90-cd3e19c90606 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.287543 May 09 18:32:51.871377 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 95/195] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:51 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:51.884263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ee849c2-7b08-4272-8900-b311226858d9 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Calling method '.version_select at 0x7fe8bad76a60>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:51.912489 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-8ee849c2-7b08-4272-8900-b311226858d9 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] HTTP exception thrown: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ee849c2-7b08-4272-8900-b311226858d9 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Request method failure captured: May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 HTTP/1.1 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV5NSLgFpkolOSHlg8bSYJAO-hGczA8Z6jeSsSiBcW6zbCjAfw8EBQyE7rCfhpJCmx27rCSYZ9S_JzAbkPyXj0MSh0QhzdFAcSjofcrmPddXJHI7__nlyT7MzPqMcrtVcdIgiqjlg9yPAujn1VAQ3_mv3io5sWnpLavkMjIgbQ7JKyc May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 77315d5439b345f5b3049b17f49c4765 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesGetTestJSON-990420676 May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:32:51.914628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/77315d5439b345f5b3049b17f49c4765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/77315d5439b345f5b3049b17f49c4765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/77315d5439b345f5b3049b17f49c4765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_77315d5439b345f5b3049b17f49c4765"}]}] May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesGetTestJSON-990420676 May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 77315d5439b345f5b3049b17f49c4765 May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesGetTestJSON-990420676 May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesGetTestJSON-990420676-project May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 95f3bf6458384c29abb0447ba60bd50a May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesGetTestJSON-990420676-project May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '32c7dce4-aff0-45bd-8c90-d3f21c0ba154'} May 09 18:32:51.915891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. (HTTP 404) (Request-ID: req-a1b5eeae-e5e3-4b30-87f5-0ba2043daa25) May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:51.916654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:32:51.917833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:32:51.918899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ee849c2-7b08-4272-8900-b311226858d9 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] Returning 404 to user: Volume 32c7dce4-aff0-45bd-8c90-d3f21c0ba154 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8ee849c2-7b08-4272-8900-b311226858d9 tempest-VolumesGetTestJSON-990420676 tempest-VolumesGetTestJSON-990420676-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154" status: 404 len: 109 microversion: 2.1 time: 0.043685 May 09 18:32:51.920932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 96/196] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:32:51 2022] GET /compute/v2.1/os-volumes/32c7dce4-aff0-45bd-8c90-d3f21c0ba154 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:51.951964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:51.959220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3763dff9-4087-4771-9505-99963c3c8ac2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.262900 May 09 18:32:51.959790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 101/197] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:51 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:52.889501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:52.893684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:52.901648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.902037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:52.903054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.904074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:52.977526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:52.978191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:52.984350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.984791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:52.985573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.986126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:53.092501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:53.100196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b59851c3-f181-4535-84bf-4d50c663ee8a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.216158 May 09 18:32:53.100869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 97/198] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:52 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:53.135982 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:53.145396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7399452e-88fa-432f-a28f-d57900b5b756 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.172530 May 09 18:32:53.146012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 102/199] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:52 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:54.118274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:54.118895 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:54.127088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.127600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:54.128639 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.129240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:54.165168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:54.165867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:54.172622 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.173298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:54.174159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.174664 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:54.331669 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:54.344845 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-00834e3d-9e01-4089-8769-64bc542f991a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.231014 May 09 18:32:54.354356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 98/200] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:54 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:54.366352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:54.374815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1d18ca4b-5b96-448b-9613-fe9c5947b34d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.215970 May 09 18:32:54.380392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 103/201] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:54 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:55.362046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:55.362650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:55.369077 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:55.369521 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.370285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:55.370730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.393192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:55.394602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:55.401447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:55.401905 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.402858 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:55.403721 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.618157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:55.626814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:55.627858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fb2d5ce3-a47f-48a0-bc19-cfdb47938393 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.269722 May 09 18:32:55.628997 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 99/202] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:55 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:55.640639 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3a894522-2140-4512-97ed-fc9658a96647 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.251526 May 09 18:32:55.642112 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 104/203] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:55 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:55.658244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-9fff2f55-6341-4b6e-8a1b-06bb791fdb71 req-d373d6a7-5dc7-484e-be2b-7713d03d65e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4cc4de-538a-4644-8de1-32d35fa56964", "name": "network-vif-plugged", "status": "completed", "tag": "d8f6bbd0-bda3-43f3-a63c-47d0f6931525"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:55.666579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9fff2f55-6341-4b6e-8a1b-06bb791fdb71 req-d373d6a7-5dc7-484e-be2b-7713d03d65e3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:55.667110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9fff2f55-6341-4b6e-8a1b-06bb791fdb71 req-d373d6a7-5dc7-484e-be2b-7713d03d65e3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.682157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-9fff2f55-6341-4b6e-8a1b-06bb791fdb71 req-d373d6a7-5dc7-484e-be2b-7713d03d65e3 service nova] Creating event network-vif-plugged:d8f6bbd0-bda3-43f3-a63c-47d0f6931525 for instance 8e4cc4de-538a-4644-8de1-32d35fa56964 on hv-cinder-83588 May 09 18:32:55.688060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-9fff2f55-6341-4b6e-8a1b-06bb791fdb71 req-d373d6a7-5dc7-484e-be2b-7713d03d65e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 May 09 18:32:55.689279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 100/204] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:56.645343 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:56.646503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:56.652900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.653722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:56.654538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.655146 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:56.660666 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:56.665174 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:56.667820 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.668343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:56.669134 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.669565 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:57.047271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:57.048418 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:57.056913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5762c662-ad3c-41ee-b71a-1616325f742d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1313 microversion: 2.1 time: 0.415846 May 09 18:32:57.057497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 105/205] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:56 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:57.057982 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cc617684-f480-462a-92ef-dfffe274cfa9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.401819 May 09 18:32:57.058726 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 101/206] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:56 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:58.076800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:58.077853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:58.081634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:58.083275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:58.088197 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.088909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.090208 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.091156 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.093213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.093954 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.095414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.096180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.289275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:58.293832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:58.297527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-66e608de-655b-44b3-aee1-9cfbf419f0bc tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1498 microversion: 2.1 time: 0.227285 May 09 18:32:58.299165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 106/207] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:58 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:58.304358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f661ffd6-7fa8-43e0-894f-60330d4652d4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.229276 May 09 18:32:58.304938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 102/208] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:58 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:58.789847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:58.790509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:58.798135 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.798973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.800079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.800912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.829152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:32:58.931668 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ec61da9a-7610-4164-a97e-bef89ceebb7a tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 204 len: 0 microversion: 2.1 time: 0.145260 May 09 18:32:58.932459 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 107/209] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:32:58 2022] DELETE /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:32:58.942697 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:58.943282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:58.949833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.950285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.951103 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.951595 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:59.095404 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:59.102943 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c19547b9-8ff2-44f0-b830-d87e5fdb110f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1504 microversion: 2.1 time: 0.164641 May 09 18:32:59.103678 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 103/210] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:58 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:59.323009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:59.323730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:59.333840 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:59.334323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:59.335416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:59.336033 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:59.467334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:59.475039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1ee59ed1-48cb-41be-b892-b77d9f368b47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.157027 May 09 18:32:59.475780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 108/211] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:32:59 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:00.120807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:00.121409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.128470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.128927 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.129758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.130194 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.295705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:00.303346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5cfc1f9d-1c76-4a5c-bdda-65fa68875c01 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1504 microversion: 2.1 time: 0.186525 May 09 18:33:00.303918 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 104/212] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:00 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:00.493377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:00.494009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.500763 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.501208 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.501968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.502390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.789106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:00.798126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-64a16333-193b-4939-a3ce-4c2ffee619fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.308648 May 09 18:33:00.798726 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 109/213] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:00 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:01.321864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:01.323022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.329791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.330456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.331425 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.332041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.572594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:01.589201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-561143ff-93e6-4195-87e3-21788e64636c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 200 len: 1504 microversion: 2.1 time: 0.269941 May 09 18:33:01.589847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 105/214] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:01 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:01.814863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:01.815701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.826555 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.827104 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.829788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.830651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.966746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-6acf09c6-0d31-436d-840d-1267dc7a3b95 req-b66ea7dd-4b47-4f2c-ab59-8e4f85465400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4cc4de-538a-4644-8de1-32d35fa56964", "name": "network-vif-deleted", "tag": "d8f6bbd0-bda3-43f3-a63c-47d0f6931525"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:01.981716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6acf09c6-0d31-436d-840d-1267dc7a3b95 req-b66ea7dd-4b47-4f2c-ab59-8e4f85465400 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.982527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6acf09c6-0d31-436d-840d-1267dc7a3b95 req-b66ea7dd-4b47-4f2c-ab59-8e4f85465400 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.009105 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-6acf09c6-0d31-436d-840d-1267dc7a3b95 req-b66ea7dd-4b47-4f2c-ab59-8e4f85465400 service nova] Creating event network-vif-deleted:d8f6bbd0-bda3-43f3-a63c-47d0f6931525 for instance 8e4cc4de-538a-4644-8de1-32d35fa56964 on hv-cinder-83588 May 09 18:33:02.015234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-6acf09c6-0d31-436d-840d-1267dc7a3b95 req-b66ea7dd-4b47-4f2c-ab59-8e4f85465400 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056682 May 09 18:33:02.016825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 106/215] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:02.077785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:02.089054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bdd51c46-64a0-4a36-940f-721b7860315e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.278062 May 09 18:33:02.090201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 110/216] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:01 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:02.609672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:02.609672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 8e4cc4de-538a-4644-8de1-32d35fa56964] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:02.616683 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.617210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.618156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.618815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.633282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] HTTP exception thrown: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Request method failure captured: May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 HTTP/1.1 May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV5Df6Jcx1C0ZgBAXycq1y74lC6m1hTyu_f0S94t9R9PV4pv0rvh2sgG66YYPUm-KBZvpB_kBfMft6DHZ19skQXoh2elp_Bml-kA4fiads3j2IsjZuuU1U5xexWfjAQPONxddBMR15JgKUWUMIrP430vQEuzuaip05oMhULh8p3Xb9s May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 3f4a24fbe14b4a39a9e756af7cd28d8b May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesActionsTest-178545265 May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:33:02.634939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4a24fbe14b4a39a9e756af7cd28d8b"}]}] May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesActionsTest-178545265 May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 3f4a24fbe14b4a39a9e756af7cd28d8b May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesActionsTest-178545265 May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesActionsTest-178545265-project May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: ba14881149754c6bb3bfaa17300ff46e May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesActionsTest-178545265-project May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. May 09 18:33:02.636372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '8e4cc4de-538a-4644-8de1-32d35fa56964'} May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:02.640744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. May 09 18:33:02.646665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:02.647840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Returning 404 to user: Instance 8e4cc4de-538a-4644-8de1-32d35fa56964 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:02.647840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cfde9995-5a5b-45a5-b018-d7d3b4a495d9 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964" status: 404 len: 111 microversion: 2.1 time: 0.033229 May 09 18:33:02.647840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 107/217] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:02 2022] GET /compute/v2.1/servers/8e4cc4de-538a-4644-8de1-32d35fa56964 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:33:02.734351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2031451052", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "networks": [{"uuid": "5eed2f69-9c58-465b-badd-168396918d29"}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:02.786741 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] validate_networks() for [('5eed2f69-9c58-465b-badd-168396918d29', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:33:03.106725 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:03.107370 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:03.113816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.114267 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.115101 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.115483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.204583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:33:03.205621 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:33:03.206114 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:33:03.206505 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:33:03.206897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:33:03.216651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.217146 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.218079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.218692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.240301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Getting quotas for project 3f4a24fbe14b4a39a9e756af7cd28d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:03.245286 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Getting quotas for user ba14881149754c6bb3bfaa17300ff46e and project 3f4a24fbe14b4a39a9e756af7cd28d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:03.257743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:33:03.260416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:33:03.263936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:03.280990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-370aff52-027a-4d34-b710-f2bc9d27e04a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.178357 May 09 18:33:03.281510 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 108/218] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:03 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:03.326715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-95157bab-c45b-4d37-9091-e4f702642e9c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596280 May 09 18:33:03.327909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 111/219] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:33:03.339764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5398f316-f053-4705-8e2c-8f0a508f3a62 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:03.340601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5398f316-f053-4705-8e2c-8f0a508f3a62 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:03.420667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5398f316-f053-4705-8e2c-8f0a508f3a62 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:03.428935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5398f316-f053-4705-8e2c-8f0a508f3a62 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1214 microversion: 2.1 time: 0.093647 May 09 18:33:03.429856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 109/220] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:03 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:04.299425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:04.301404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:04.308158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.308699 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.309491 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.309925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.447067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:04.447564 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:04.462981 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.463669 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.468752 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.469960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.530684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.539733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-636476bb-0df9-41d0-9862-a0d3ae1749e4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.245834 May 09 18:33:04.540754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 112/221] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:04 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:04.552458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.568272 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f802e5cd-5489-4289-8d29-f341279c2a10 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1218 microversion: 2.1 time: 0.126198 May 09 18:33:04.569348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 110/222] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:04 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:05.557024 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:05.557632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:05.574159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.575014 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.576185 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.577343 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.586048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:05.587768 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:05.599031 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.599349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.600170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.600610 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.781612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:05.799986 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-192fd2b1-9855-4781-9e79-57e7d939756c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1210 microversion: 2.1 time: 0.216098 May 09 18:33:05.801637 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 111/223] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:05 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:05.856350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:05.864102 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-72b3dff2-d61b-4814-a0f9-8917368464ca tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.310941 May 09 18:33:05.876039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 113/224] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:05 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:06.817739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:06.818520 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:06.826849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.827800 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.829097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.829879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.883463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:06.883463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:06.890448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.891171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.892216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.892864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:07.018941 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:07.027560 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-dca88692-2ab2-47ed-a8c8-abebe0d39c7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1272 microversion: 2.1 time: 0.214043 May 09 18:33:07.043355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 112/225] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:06 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:07.132701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:07.142595 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3d865e52-afcb-4ca4-80ce-802f9362edcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.264961 May 09 18:33:07.143937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 114/226] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:06 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:08.044715 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:08.045519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:08.053717 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.054173 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.054963 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.055401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.167074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:08.168711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:08.175966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.176824 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.177829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.178485 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.593322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:08.605489 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4e301113-7779-4fd4-8bce-3f41d18b3a7c tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.564841 May 09 18:33:08.608498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 113/227] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:08 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:08.618646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:08.626246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-35229820-128a-4a6e-8828-e656eaf43bcb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.469249 May 09 18:33:08.627054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 115/228] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:08 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:09.077009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-565e59da-1f47-4044-aab2-3499691a9b8d req-665ffd9f-e0be-461d-99aa-f9f744b45a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b96638-4407-4a6d-9199-982e3a6084e3", "tag": "74657e45-1b84-4495-99cd-a18b82d4adcf"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:09.088187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-565e59da-1f47-4044-aab2-3499691a9b8d req-665ffd9f-e0be-461d-99aa-f9f744b45a9b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.088889 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-565e59da-1f47-4044-aab2-3499691a9b8d req-665ffd9f-e0be-461d-99aa-f9f744b45a9b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.103113 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-565e59da-1f47-4044-aab2-3499691a9b8d req-665ffd9f-e0be-461d-99aa-f9f744b45a9b service nova] Creating event network-changed:74657e45-1b84-4495-99cd-a18b82d4adcf for instance 63b96638-4407-4a6d-9199-982e3a6084e3 on hv-cinder-83588 May 09 18:33:09.108769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-565e59da-1f47-4044-aab2-3499691a9b8d req-665ffd9f-e0be-461d-99aa-f9f744b45a9b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035487 May 09 18:33:09.109544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 114/229] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:09.624495 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:09.625108 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:09.636351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.637540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.641229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.642404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.643072 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:09.644032 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:09.658168 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.658982 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.659721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.660192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:10.097928 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:10.103023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:10.117342 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8a669ebc-e710-4dee-8d44-d299fde09e3e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1523 microversion: 2.1 time: 0.478317 May 09 18:33:10.117996 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 115/230] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:09 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1523 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:10.118569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a51329ad-7c4e-4205-9735-0f115217cb12 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.495785 May 09 18:33:10.128864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 116/231] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:09 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:11.141488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:11.148871 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:11.149575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:11.150904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:11.167463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.183822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.186282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.187037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.190026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.190801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.191449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.193084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.593871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:11.604027 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-41c5ec90-6d09-43da-a8fe-da01c31acca1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1503 microversion: 2.1 time: 0.473925 May 09 18:33:11.610180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 116/232] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:11 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:11.628748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:11.630065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:11.640926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.641760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.643971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.644822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.645476 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:11.669486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1f182d3f-27c4-472c-ab69-37d825882be4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.535091 May 09 18:33:11.670687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 117/233] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:11 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:12.025810 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:12.035865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6e6efff4-42b4-4123-a4b5-c1db7af541ba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1515 microversion: 2.1 time: 0.413634 May 09 18:33:12.036719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 117/234] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:11 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1515 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:12.688080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:12.688754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:12.698010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.698797 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.699686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.700337 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.911325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:12.924188 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-74e8ccc4-8161-4eb6-b776-819ec593d40d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.241109 May 09 18:33:12.925111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 118/235] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:12 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:13.941828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:13.942446 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:13.953843 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.954310 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:13.970512 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.970512 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.166893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:14.186431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-67b65587-14fc-4cbd-8580-a93573aee7d2 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.248735 May 09 18:33:14.187020 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 118/236] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:13 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:14.641029 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:14.642148 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:14.650548 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.651156 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.652050 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.653571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.704369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lazy-loading 'flavor' on Instance uuid f4246c50-6390-4bc7-80e5-1af76bf497d8 {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:33:14.801973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-78082c96-7a76-440d-8d43-a55a4609001d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/action" status: 200 len: 32 microversion: 2.1 time: 0.164446 May 09 18:33:14.802612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 119/237] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:33:14 2022] POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:33:14.813397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:14.814408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:14.822320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.823099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.824240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.824736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.069736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:15.077551 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e7316ff3-3eee-45ab-b54a-3682cd0e5fd3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.268299 May 09 18:33:15.084933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 119/238] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:14 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:15.204305 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:15.205018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:15.211899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.212558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.213570 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.214187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.445812 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:15.456655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d1856244-1dda-4d77-8bed-7788f8f2795d tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.256642 May 09 18:33:15.457658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 120/239] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:15 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:16.096738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:16.097950 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:16.114676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.115135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.115989 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.116425 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.481577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:16.482963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:16.494473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.495244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.496225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.496808 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.588496 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:16.598426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8024aaa2-81a8-4c31-a0f6-fc9eb85b00dc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.505902 May 09 18:33:16.609052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 120/240] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:16 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:16.693635 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:16.710423 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7e6215e3-9c31-44ee-96d2-f257c5fe312f tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.231388 May 09 18:33:16.713503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 121/241] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:16 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:17.617290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.617865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.635818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.636395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.637378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.638222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.734518 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.736222 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.749258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.750010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.753749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.754875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:18.023834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:18.033879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-80ff03c7-2e7c-471d-b5ef-4bc57be8a155 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.420377 May 09 18:33:18.035066 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 121/242] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:17 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:18.112391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:18.121909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c9e0d2f4-d443-44cf-8263-33759386bd75 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.393957 May 09 18:33:18.122502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 122/243] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:17 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:19.061460 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:19.062268 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:19.072018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.072966 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.075681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.076320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.138695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:19.139309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:19.166253 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.167067 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.167862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.168315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.435049 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.443873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-62e0049f-26ec-456f-a946-3e62709b9b69 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.309074 May 09 18:33:19.445053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 123/244] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:19 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:19.470308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.482337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-29c7fcc0-2976-44ff-b18c-973916c8a454 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.434098 May 09 18:33:19.493614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 122/245] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:19 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:19.891117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-9440615e-ad07-4c17-826f-921d02156f5e req-63ea31c2-2784-4e86-946b-c480f9949943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b96638-4407-4a6d-9199-982e3a6084e3", "name": "network-vif-plugged", "status": "completed", "tag": "74657e45-1b84-4495-99cd-a18b82d4adcf"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:19.904363 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-9440615e-ad07-4c17-826f-921d02156f5e req-63ea31c2-2784-4e86-946b-c480f9949943 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.904803 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-9440615e-ad07-4c17-826f-921d02156f5e req-63ea31c2-2784-4e86-946b-c480f9949943 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.926566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-9440615e-ad07-4c17-826f-921d02156f5e req-63ea31c2-2784-4e86-946b-c480f9949943 service nova] Creating event network-vif-plugged:74657e45-1b84-4495-99cd-a18b82d4adcf for instance 63b96638-4407-4a6d-9199-982e3a6084e3 on hv-cinder-83588 May 09 18:33:19.943404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-9440615e-ad07-4c17-826f-921d02156f5e req-63ea31c2-2784-4e86-946b-c480f9949943 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056207 May 09 18:33:19.946802 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 124/246] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:20.463673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:20.464393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:20.494417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.495067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.507921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:20.508812 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:20.518236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.520365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.521039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.521686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.522724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.523348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.814847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.833587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0e5de1fb-347e-4599-a535-f6b5ee4d27d2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.335763 May 09 18:33:20.835232 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 125/247] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:20 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:20.852052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.860099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e6f15661-d0bd-40b8-9a48-42e31522febf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.400647 May 09 18:33:20.863276 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 123/248] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:20 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:20.919339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:20.919339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:20.925553 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.926375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.927304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.927876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.955329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-143c371c-a365-4238-a857-02eabd7b677d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/ips" status: 200 len: 149 microversion: 2.1 time: 0.047824 May 09 18:33:20.957915 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 126/249] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:33:20 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:21.853543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:21.854452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:21.864219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.864679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.865462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.867382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.881501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:21.882107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:21.892784 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.893234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.894044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.894479 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:22.165846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:22.176412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f57b9a65-2db4-4411-a058-fe7b3345fce1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.328632 May 09 18:33:22.179386 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 124/250] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:21 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:22.184897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:22.193740 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-62e4afa0-1b59-4735-8a40-583222f95dfd tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1314 microversion: 2.1 time: 0.316172 May 09 18:33:22.195002 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 127/251] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:21 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:22.632083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e117b71-42ac-44bb-970f-0216f529d766"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:22.633070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:22.641183 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.641872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:22.642803 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.643382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.024645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-79b5c9e6-b60b-4390-b32c-477d824bdad2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396608 May 09 18:33:23.026634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 125/252] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:33:22 2022] POST /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:23.195812 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:23.196458 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:23.203492 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.204156 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.205220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.205803 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.215571 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:23.216734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:23.235459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.236552 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.237694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.238327 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.441342 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.449760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-39d5f6b4-9413-485d-96a8-4e3a05860e47 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.259947 May 09 18:33:23.450599 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 128/253] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:23 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:23.453160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.461662 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0869d831-e30d-41b6-8916-407ef6fba1a4 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1499 microversion: 2.1 time: 0.254279 May 09 18:33:23.462256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 126/254] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:23 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1499 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:24.171274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:24.171943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:24.181064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.182129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.183254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.184295 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.218145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:33:24.320341 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-be0a3d54-ad87-4ab0-a4f8-41832b077bd1 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "DELETE /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 204 len: 0 microversion: 2.1 time: 0.152971 May 09 18:33:24.321039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 129/255] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:33:24 2022] DELETE /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:33:24.329246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:24.330576 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:24.339320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.339906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.340815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.341348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.469206 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:24.470686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:24.478701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.479615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.480934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.481583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.485273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:24.497803 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a72e62a3-81c7-4897-bb4d-443814a46b94 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1505 microversion: 2.1 time: 0.172348 May 09 18:33:24.498866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 127/256] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:24 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:24.647700 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:24.656385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a769674f-a9b4-4b5d-9485-a5b8d2fb9caf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.192924 May 09 18:33:24.657219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 130/257] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:24 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:25.523210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:25.526319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:25.540570 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.541755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.543870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.545160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.674865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:25.675879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:25.697192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.698296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.700639 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.704552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.954812 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:25.977965 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f2cb0daa-98ab-4181-80ef-d8e8993a3e68 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1505 microversion: 2.1 time: 0.465241 May 09 18:33:25.978974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 128/258] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:25 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:26.024127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:26.043377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ab8d5e48-c6c2-4495-b1af-65fcd4958da1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.373072 May 09 18:33:26.043913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 131/259] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:25 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:27.001562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:27.009477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:27.030034 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.030804 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.032166 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.044478 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.046242 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-3536bb98-f3c7-4602-88aa-b43a910d779b req-0ab88bb0-07b5-4e34-aade-5ec4a35cc40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b96638-4407-4a6d-9199-982e3a6084e3", "name": "network-vif-deleted", "tag": "74657e45-1b84-4495-99cd-a18b82d4adcf"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:27.077628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-3536bb98-f3c7-4602-88aa-b43a910d779b req-0ab88bb0-07b5-4e34-aade-5ec4a35cc40a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.088904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-3536bb98-f3c7-4602-88aa-b43a910d779b req-0ab88bb0-07b5-4e34-aade-5ec4a35cc40a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.121404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-3536bb98-f3c7-4602-88aa-b43a910d779b req-0ab88bb0-07b5-4e34-aade-5ec4a35cc40a service nova] Creating event network-vif-deleted:74657e45-1b84-4495-99cd-a18b82d4adcf for instance 63b96638-4407-4a6d-9199-982e3a6084e3 on hv-cinder-83588 May 09 18:33:27.150875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-3536bb98-f3c7-4602-88aa-b43a910d779b req-0ab88bb0-07b5-4e34-aade-5ec4a35cc40a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112259 May 09 18:33:27.151886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 132/260] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 09 18:33:27.165166 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:27.166366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:27.202415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.217053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.218839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.219848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.260201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba14881149754c6bb3bfaa17300ff46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a24fbe14b4a39a9e756af7cd28d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.278644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-873e9533-5428-493e-820d-04b8eb6b5f05 tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 200 len: 1463 microversion: 2.1 time: 0.286622 May 09 18:33:27.279279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 129/261] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:26 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:27.485639 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.494819 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-cc536fe0-ecba-4749-bd9c-e75bf7c82e97 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.336882 May 09 18:33:27.496611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 133/262] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:27 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:27.811553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f1b3bed0-4a00-4a5e-b44e-71152f4fc6ce tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'create', calling method: .version_select at 0x7fe8badd30d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1214391683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgS8S3MfCrd1FjTtGPCmIa5QHVhbb6MHNSF7A2XMc4RN1P2DvLVyImQrMn5VE1HnR+6vZsVG5zihJ+RKYtQYNgXp72Wce19PZMpmfy+DYECvNM1Al+hDJ97yALVs7DGhA=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:27.831115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-f1b3bed0-4a00-4a5e-b44e-71152f4fc6ce tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Getting quotas for project 4bcfbd7c368b4090868727d9dadf0ad2. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:27.838150 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-f1b3bed0-4a00-4a5e-b44e-71152f4fc6ce tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Getting quotas for user cb748c2f041944a2b81b46f9e8eae2ca and project 4bcfbd7c368b4090868727d9dadf0ad2. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:27.863669 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f1b3bed0-4a00-4a5e-b44e-71152f4fc6ce tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055913 May 09 18:33:27.864477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 130/263] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:33:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:27.960793 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1296603329", "imageRef": "3dec19db-fb8b-47a1-9f77-8b50e26700ac", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1214391683", "networks": [{"uuid": "1654d44a-1797-4053-a242-2c9186fcf10f"}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:28.013237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] validate_networks() for [('1654d44a-1797-4053-a242-2c9186fcf10f', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:33:28.308301 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:28.308921 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] [instance: 63b96638-4407-4a6d-9199-982e3a6084e3] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:28.315523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.315977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.316791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.317230 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.331457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] HTTP exception thrown: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Request method failure captured: May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 HTTP/1.1 May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV5Df6Jcx1C0ZgBAXycq1y74lC6m1hTyu_f0S94t9R9PV4pv0rvh2sgG66YYPUm-KBZvpB_kBfMft6DHZ19skQXoh2elp_Bml-kA4fiads3j2IsjZuuU1U5xexWfjAQPONxddBMR15JgKUWUMIrP430vQEuzuaip05oMhULh8p3Xb9s May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 3f4a24fbe14b4a39a9e756af7cd28d8b May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesActionsTest-178545265 May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:33:28.333176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f4a24fbe14b4a39a9e756af7cd28d8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f4a24fbe14b4a39a9e756af7cd28d8b"}]}] May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesActionsTest-178545265 May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 3f4a24fbe14b4a39a9e756af7cd28d8b May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesActionsTest-178545265 May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesActionsTest-178545265-project May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: ba14881149754c6bb3bfaa17300ff46e May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesActionsTest-178545265-project May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. May 09 18:33:28.334911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '63b96638-4407-4a6d-9199-982e3a6084e3'} May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:28.335711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. May 09 18:33:28.337163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:33:28.338368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] Returning 404 to user: Instance 63b96638-4407-4a6d-9199-982e3a6084e3 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:28.338368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e086b292-15fb-49b6-8937-00ab58e341bf tempest-VolumesActionsTest-178545265 tempest-VolumesActionsTest-178545265-project] 10.222.0.35 "GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3" status: 404 len: 111 microversion: 2.1 time: 0.031473 May 09 18:33:28.338368 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 131/264] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:28 2022] GET /compute/v2.1/servers/63b96638-4407-4a6d-9199-982e3a6084e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:33:28.388755 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:33:28.389281 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:33:28.389850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:33:28.390353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:33:28.391043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:33:28.406190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.406931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.407935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.408559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.427277 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Getting quotas for project 4bcfbd7c368b4090868727d9dadf0ad2. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:28.431806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Getting quotas for user cb748c2f041944a2b81b46f9e8eae2ca and project 4bcfbd7c368b4090868727d9dadf0ad2. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:28.444947 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:33:28.447703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3dec19db-fb8b-47a1-9f77-8b50e26700ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:33:28.500922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bed2415f-6cb3-4cbe-aaee-bba11df0e07a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541083 May 09 18:33:28.500922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 134/265] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:33:28.513665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c4c2ad1d-5252-4c5d-89e3-cb637812ba6d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:28.514663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c4c2ad1d-5252-4c5d-89e3-cb637812ba6d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:28.523489 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:28.524359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:28.532422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.532863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.533687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.534361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.611047 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c4c2ad1d-5252-4c5d-89e3-cb637812ba6d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:28.631743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c4c2ad1d-5252-4c5d-89e3-cb637812ba6d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1259 microversion: 2.1 time: 0.124779 May 09 18:33:28.632616 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 132/266] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:28 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1259 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:28.767411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:28.779306 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-363c60b6-5377-4b94-aa6a-db668e4e848d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.260052 May 09 18:33:28.780037 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 135/267] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:28 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:28.873818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2138046126", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:28.940881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] validate_networks() for None {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:33:29.305343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:33:29.305828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:33:29.306337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:33:29.306892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:33:29.307340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:33:29.319027 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.320117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.321120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.321884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.357954 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Getting quotas for project 50df5bb816524124bd71f9365a2249bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:29.364778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Getting quotas for user b5873d67cd3848c2a8efc5006d7ee9af and project 50df5bb816524124bd71f9365a2249bf. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:29.377487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:33:29.379777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:33:29.422539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2ee320d9-d37b-4528-ab04-0764c7710cd9 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557446 May 09 18:33:29.423080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 133/268] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:33:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:33:29.434091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b31f25fa-de9e-43a8-a9eb-5811e5a518df tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:29.435109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b31f25fa-de9e-43a8-a9eb-5811e5a518df tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:29.492958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b31f25fa-de9e-43a8-a9eb-5811e5a518df tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:29.502140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b31f25fa-de9e-43a8-a9eb-5811e5a518df tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1215 microversion: 2.1 time: 0.072495 May 09 18:33:29.502900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 136/269] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:29 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:29.653686 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:29.654911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:29.668196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.668915 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.670208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.670775 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.747996 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:29.757925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fb6c5dfe-a579-44bb-9195-73d3a222e6a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1255 microversion: 2.1 time: 0.111934 May 09 18:33:29.759261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 134/270] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:29 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1255 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:29.808345 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:29.809126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:29.818301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.819008 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.820106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.820835 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.955820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:29.964065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4991d447-d0e9-4e3d-88bf-db131c4b9030 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.160758 May 09 18:33:29.964762 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 137/271] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:29 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:30.520386 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:30.521036 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:30.528450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.528899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.529701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.530132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.598827 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:30.607388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-25fffe4d-b8b3-42ee-bad8-fb5b0b8e8a2b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1219 microversion: 2.1 time: 0.091034 May 09 18:33:30.607991 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 135/272] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:30 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:30.776789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:30.777759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:30.784502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.784957 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.785788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.786217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.849184 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:30.857183 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4fdc29ad-0d3f-4833-9110-35c7f4d42fa0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1255 microversion: 2.1 time: 0.084590 May 09 18:33:30.857809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 138/273] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:30 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:30.982019 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:30.982857 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:30.989543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.990004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.990792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.991234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.127491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:31.135503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-60d27b99-b6b3-466e-b7f4-9d07aaea7f9e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.158143 May 09 18:33:31.136129 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 136/274] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:30 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:31.624352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:31.624964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.632396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.632861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.633648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.634081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.700878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:31.708452 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-07c6bfff-7c37-43fd-aa1a-44bd7d7c0e55 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1219 microversion: 2.1 time: 0.088040 May 09 18:33:31.709225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 139/275] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:31 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:31.875018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:31.875644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.882745 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.883197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.883987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.884439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.948850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:31.959267 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-025eb4b8-14fd-40eb-806c-3ea509798afb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1255 microversion: 2.1 time: 0.088230 May 09 18:33:31.959828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 137/276] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:31 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1255 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.158728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:32.163413 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:32.174871 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.176421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.178111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.179182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.366034 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:32.374013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7f5d6e40-efea-4241-a511-c528f930b50e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.223794 May 09 18:33:32.374667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 140/277] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:32 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.726640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:32.727278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:32.733900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.734350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.735155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.735677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.798499 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:32.808345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0db2848c-57bc-4625-8ca1-ea96171bf25f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1267 microversion: 2.1 time: 0.085360 May 09 18:33:32.809287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 138/278] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:32 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.945906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8d0c106b-227f-465f-97d5-201a33c80332 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: .version_select at 0x7fe8bad80dc0>, body: {"keypair": {"name": "tempest-keypair-1834098930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtBHTy9NTlwZEGWQc8lqQyAZvfOR5i4D1VkTA7wK8jF9ubiEuJISYTgQVePBIBdVmNu8l8CiMeeDthvqumeWCzxapFS5JrWehkljnGuFRRzeA/xeG27MJ3FxtJsqyGCww=="}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:32.966539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-8d0c106b-227f-465f-97d5-201a33c80332 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:32.970734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-8d0c106b-227f-465f-97d5-201a33c80332 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:32.977988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:32.980238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:32.991541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.992472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.993577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.994895 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.013082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8d0c106b-227f-465f-97d5-201a33c80332 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072176 May 09 18:33:33.013694 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 141/279] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:33:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:33.067682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:33.076276 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b5092ff7-b969-44b5-b56c-d0193fdec786 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1329 microversion: 2.1 time: 0.103034 May 09 18:33:33.076857 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 139/280] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:32 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:33.404074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:33.407532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:33.423471 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.423933 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.424754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.425190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.827306 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:33.828568 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:33.838405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.839322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.840428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.841165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.036982 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.049771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e0c6a6bd-cf94-44c0-a361-a83528f729cf tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1273 microversion: 2.1 time: 0.226160 May 09 18:33:34.053983 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 140/281] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:33 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:34.102365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:34.104881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:34.122431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.127339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.131971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.133075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.136126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.151031 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6ce65206-6b4c-4b38-87f3-433301b6cf4d tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.763517 May 09 18:33:34.168053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 142/282] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:33 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:34.271133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.285423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e6c53c43-1957-4701-9eaa-7a5e911e94bc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1317 microversion: 2.1 time: 0.187134 May 09 18:33:34.296198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 141/283] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:34 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:35.084000 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.084624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.105898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.106356 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.107159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.107596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.169220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.170589 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.194023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.194601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.195277 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.195712 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.291895 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:35.317742 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9d65d15b-dd45-490b-9ed2-3bd57fd5e865 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1273 microversion: 2.1 time: 0.221531 May 09 18:33:35.322078 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 143/284] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:35.337822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.341185 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.358145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.359036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.365549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.366498 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.865645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:35.878031 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a77177ba-c03b-4a89-b35b-d241ad618939 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.712674 May 09 18:33:35.880304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 142/285] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:36.348497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:36.350014 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:36.362670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.363688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.364718 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.370114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.431616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:36.459238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-360ddbf8-8a01-43b3-8069-77103b5c2d82 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 1.134598 May 09 18:33:36.464579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 144/286] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:36.818662 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:36.826435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-26d7278e-3bad-4def-bd6a-7f664c3db2e5 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1273 microversion: 2.1 time: 0.482074 May 09 18:33:36.827017 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 143/287] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:36 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:36.898210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:36.899545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:36.913177 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.914017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.915075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.916312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.488533 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:37.489185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:37.505589 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.506040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.506840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.517572 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.800899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:37.811591 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bacc8a81-f244-4d0b-881f-032fa89f3dff tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.918459 May 09 18:33:37.829191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 145/288] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:36 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:37.860345 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:37.860922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:37.871089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.871540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.872614 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.873202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.221151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:38.227882 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:38.246263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3ce30967-b49c-4fd8-9b2f-262b6e1251ae tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.762614 May 09 18:33:38.250536 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a075a585-afa6-4341-8e65-6c6d633a917b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.394032 May 09 18:33:38.262814 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 144/289] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:37 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:38.273972 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 146/290] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:37 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:38.498745 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-dfe04bc8-8138-4e60-8faa-bf6110d1cc3e req-17f90fd4-4c76-4092-8ff9-a7f2eb84ee3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:38.545279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-dfe04bc8-8138-4e60-8faa-bf6110d1cc3e req-17f90fd4-4c76-4092-8ff9-a7f2eb84ee3b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.550399 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-dfe04bc8-8138-4e60-8faa-bf6110d1cc3e req-17f90fd4-4c76-4092-8ff9-a7f2eb84ee3b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.602948 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-dfe04bc8-8138-4e60-8faa-bf6110d1cc3e req-17f90fd4-4c76-4092-8ff9-a7f2eb84ee3b service nova] Creating event network-changed:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:33:38.622128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-dfe04bc8-8138-4e60-8faa-bf6110d1cc3e req-17f90fd4-4c76-4092-8ff9-a7f2eb84ee3b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127244 May 09 18:33:38.623314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 145/291] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:38.848781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:38.849676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:38.862579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.863090 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.869386 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.870005 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.935172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-9b970f72-1a29-45fb-b8ee-aa35d3f83448 req-a5519598-5243-4953-94fe-00a5076922b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea408f-3c1f-424f-9688-eca90b44afcc", "tag": "b774a5f3-3a33-47b9-8f8e-92e04b9e57c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:38.954316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9b970f72-1a29-45fb-b8ee-aa35d3f83448 req-a5519598-5243-4953-94fe-00a5076922b1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.966738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9b970f72-1a29-45fb-b8ee-aa35d3f83448 req-a5519598-5243-4953-94fe-00a5076922b1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.011297 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-9b970f72-1a29-45fb-b8ee-aa35d3f83448 req-a5519598-5243-4953-94fe-00a5076922b1 service nova] Creating event network-changed:b774a5f3-3a33-47b9-8f8e-92e04b9e57c4 for instance b1ea408f-3c1f-424f-9688-eca90b44afcc on hv-cinder-83588 May 09 18:33:39.026328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-9b970f72-1a29-45fb-b8ee-aa35d3f83448 req-a5519598-5243-4953-94fe-00a5076922b1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093052 May 09 18:33:39.027606 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 146/292] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:39.271742 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:39.272851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:39.280348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.281239 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.282423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.283061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.900355 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:39.920463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e06ce547-dcee-4753-ac9d-bd468eda4e80 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 1.078620 May 09 18:33:39.922936 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 147/293] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:38 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:39.938307 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:39.938914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:39.945643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.946081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.946955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.947382 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.999891 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:40.010454 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-55bb9a50-956c-478e-b5f9-a87d9fc43f03 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.743608 May 09 18:33:40.014687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 147/294] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:39 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:40.533555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-896848115", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e53078e-3a76-4ed9-ad6f-470a933d3075"}], "security_groups": [{"name": "tempest-securitygroup--974662683"}], "key_name": "tempest-keypair-1834098930", "user_data": "}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:41.338444 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:41.351279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0cdf1e07-93a6-4a0b-9d58-7c53f487f37a tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 1.416838 May 09 18:33:41.352280 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 148/295] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:39 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:41.359916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:41.360912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:41.376813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.377265 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.378194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.378642 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.605222 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:41.616539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3c22410b-6431-4202-bd43-ea783b46b781 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.262695 May 09 18:33:41.617101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 149/296] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:41 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:41.632198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:41.632904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:41.642156 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.642964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.644615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.645997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.852801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:41.865544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-aeb26806-6964-43bf-be6d-9dd7bf3344f0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.237442 May 09 18:33:41.866826 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 150/297] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:41 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:42.370464 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:42.371812 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:42.381334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.382402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.384926 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.385520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.608497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:42.616730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b86c30e5-86d5-4e83-9b7f-419a1b818412 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.250193 May 09 18:33:42.617760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 151/298] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:42 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:42.635231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:42.635898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:42.646084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.648091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.649127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.649649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.928579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:42.939718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ebaa2512-cad2-4114-954b-cc1e6b88d61a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.309729 May 09 18:33:42.940351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 152/299] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:42 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:42.945348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:42.945999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:42.953220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.953739 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.954861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.955366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.416005 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:43.427689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-395050cf-54dd-4b49-a588-57ce94091d3a tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.486217 May 09 18:33:43.431135 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 153/300] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:42 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:43.640403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:43.641484 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:43.666475 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.668923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.670833 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.673274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.011409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:44.022188 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-482cef63-5507-4223-bf04-390698009b5e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.388742 May 09 18:33:44.026512 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 154/301] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:43 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:44.045983 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:44.047481 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:44.065569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.066125 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.067237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.067842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.382469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:44.397977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9b4f11cd-3cc1-421e-8124-e71812a61536 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.359599 May 09 18:33:44.398814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 155/302] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:44 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:44.450791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:44.451490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:44.460982 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.461466 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.462400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.462865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.751857 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:44.780615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-634399d7-31df-412c-a683-668365b8ca81 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.333067 May 09 18:33:44.808010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 156/303] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:44 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:45.052707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:45.053534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:45.063805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.064553 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.066320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.067220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.282603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:45.297359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7b1a2a50-3455-413a-a980-f210887f4c72 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.252142 May 09 18:33:45.308460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 157/304] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:45 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:45.429082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:45.430136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:45.441827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.442573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.444049 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.444886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.679309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:45.696671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-afbfb015-2d99-4965-affc-c8bd66dd48d6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.273818 May 09 18:33:45.697920 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 158/305] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:45 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:45.821644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:45.823809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:45.848277 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.849737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.859158 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.861528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.123887 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:46.135608 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c2bd7bb4-a1b4-47c5-b5d0-9b7923aff346 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.323804 May 09 18:33:46.150418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 159/306] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:45 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:46.331590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:46.332729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:46.339689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.340632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.341617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.342204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.638957 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:46.650346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9608078f-1026-440a-b4eb-d92c39b3e433 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.322593 May 09 18:33:46.651141 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 160/307] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:46 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:46.720533 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:46.721438 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:46.743861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.744817 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.746037 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.747428 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.919942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:46.932019 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-12424dc3-0014-4c2e-a2ef-0950d920c1b4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.216563 May 09 18:33:46.942417 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 161/308] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:46 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:47.161619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:47.162450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:47.176425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.177245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.178245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.178831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.382057 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:47.395452 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a025c063-5f0a-4ca8-ac21-8a96adf4c438 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.239122 May 09 18:33:47.396894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 162/309] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:47 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:47.680354 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:47.681619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:47.698458 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.699117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.701046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.704295 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.942184 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:47.954501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9ede9258-b534-40c2-8168-07781848ff03 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.280827 May 09 18:33:47.964200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 163/310] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:47 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:47.964638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] validate_networks() for [('6e53078e-3a76-4ed9-ad6f-470a933d3075', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:33:47.973630 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:47.973630 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:47.984065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.984541 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.985316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.986003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:48.231062 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:48.245251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1a395672-dcbc-45d9-8ee5-aa70790c7f8b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.284744 May 09 18:33:48.261745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 164/311] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:47 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:48.418380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:48.419538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:48.460941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:48.466366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:48.468079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:48.468966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:48.642511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:33:48.643187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:33:48.643988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:33:48.644674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:33:48.645457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:33:48.665964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:48.667185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:48.669044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:48.670130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:48.732121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:48.736607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:48.740387 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:48.748564 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8ccbc5a0-35e3-4dc5-8e2d-c3be476c35a2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.337523 May 09 18:33:48.763976 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 165/312] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:48 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:48.783202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:33:48.786984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:33:48.862002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-86aec66d-2e99-46bb-a5d3-4547d3c9c172 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.332646 May 09 18:33:48.862826 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 148/313] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:33:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 8335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 18:33:48.874735 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3f7198f7-e411-44ec-9b70-15f1784290b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:48.875750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3f7198f7-e411-44ec-9b70-15f1784290b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:48.991459 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3f7198f7-e411-44ec-9b70-15f1784290b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:48.997099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:49.005621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:49.009395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3f7198f7-e411-44ec-9b70-15f1784290b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1241 microversion: 2.1 time: 0.139030 May 09 18:33:49.010368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 166/314] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:48 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:49.031048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.031768 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.033126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.033867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.275447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:49.276213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:49.278303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:49.285004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.286150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.288009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.288698 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.295097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9b36a348-7885-4e4d-9bdc-bb98a38ba6b3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.312195 May 09 18:33:49.295097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 149/315] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:48 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:49.472480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:49.481528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c4450b44-e655-4951-ae6b-7aaaf516122a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.213083 May 09 18:33:49.483264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 167/316] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:49 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:49.779753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:49.780945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:49.788435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.789189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.790409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.791043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.958748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:49.973540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7bcd96a4-69e7-48bf-be19-658def5043b2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.198472 May 09 18:33:49.992913 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 150/317] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:49 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:50.031181 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:50.031774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:50.039367 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.040369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.041400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.042019 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.118625 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:50.127020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0d8fa5d2-fa5e-459d-88c9-2d391c4f810b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1237 microversion: 2.1 time: 0.100263 May 09 18:33:50.127620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 168/318] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:50 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:50.312407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:50.314081 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:50.320511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.321175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.322018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.322385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.500147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:50.500893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:50.507584 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.508180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.508978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.509427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.525413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:50.536779 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-eb3393ea-08fc-4ccd-bb22-5561c064ba9b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.228401 May 09 18:33:50.537892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 151/319] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:50 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:50.661539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:50.669860 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f21300c5-3c06-4e7f-8e02-40cbbb48e749 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.174918 May 09 18:33:50.679700 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 169/320] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:50 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:51.005299 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.017358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.047819 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.048630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.049558 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.050068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.147718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.149374 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.156790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.157252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.158475 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.158475 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.269785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:51.280014 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-88e218cf-9fb2-45de-a427-67b6411aaff6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1237 microversion: 2.1 time: 0.136161 May 09 18:33:51.291303 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 170/321] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:51 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:51.306839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:51.318670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c02bd706-f4e3-4e2c-88db-5cbf46c59c69 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.322921 May 09 18:33:51.319579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 152/322] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:50 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:51.553923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.554601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.568204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.569047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.569944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.570398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.687625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.688648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.701342 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.701963 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.703231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.705283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.782868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:51.799674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-010edf9b-7e12-416d-a2b9-af8fc0948971 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.249642 May 09 18:33:51.802329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 171/323] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:51 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:51.998386 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:52.006851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fd8247a6-e647-451b-8d11-46de6406f0fb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.323744 May 09 18:33:52.007924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 153/324] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:51 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:52.307672 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:52.308511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:52.324166 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.324953 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.326458 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.328298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.338780 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:52.340728 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:52.356311 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.357054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.358830 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.359509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.461384 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:52.483746 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ac410596-24ef-4b65-9423-380e42023a6a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1301 microversion: 2.1 time: 0.189331 May 09 18:33:52.496127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 172/325] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:52 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1301 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:52.632687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:52.641482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-afbc64f9-bd36-4969-b427-b8ab2263695d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.307444 May 09 18:33:52.642711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 154/326] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:52 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:52.827763 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:52.830065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:52.842664 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.844120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.846087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.846977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.027345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:53.028672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:53.040237 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.042975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.044950 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.047460 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.092224 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:53.101564 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9839e134-ab4a-40c1-92c8-b88150972a65 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.285397 May 09 18:33:53.112835 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 173/327] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:52 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:53.233934 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:53.242385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-92d79d31-e517-4ab9-98f8-bd501e228124 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.220234 May 09 18:33:53.243378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 155/328] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:53 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:53.505792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:53.506846 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:53.517092 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.517956 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.519128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.519860 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.603583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:53.612142 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bcee7410-616b-4fd6-bf2d-8a4f96b8c586 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1299 microversion: 2.1 time: 0.114191 May 09 18:33:53.612864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 174/329] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:53 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:53.669927 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:53.670547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:53.677143 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.677598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.678379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:53.678827 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.836582 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:53.845295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cffeebac-1a5c-49ef-8587-2e1d518d202e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.180208 May 09 18:33:53.845939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 156/330] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:53 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:54.118925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.120080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.126780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.127442 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.128490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.129077 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.266375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.267742 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.282822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.284161 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.285962 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.287197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.325001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:54.341237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f558e42d-3ae2-47b8-81e8-d48b4e651ec7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.225883 May 09 18:33:54.342057 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 175/331] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:54.495281 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:54.504124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-dcb5b214-4391-4faf-850f-5a826d743fee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1501 microversion: 2.1 time: 0.245306 May 09 18:33:54.505087 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 157/332] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:54.522524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4c29db9-32a6-462c-9a32-24fb482b45b8"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:54.524900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.532561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.533289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.534136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.534679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.562319 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] HTTP exception thrown: Cannot 'attach_volume' instance f4246c50-6390-4bc7-80e5-1af76bf497d8 while it is in vm_state rescued May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Request method failure captured: May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/os-volume_attachments HTTP/1.1 May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 74 May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4LBU3oVmpQ7Qzk4dnuc5jbFUFVFj9XAGi5_-1sRTA43vOXwrRrtzNspTaml6xfFYfsdudnJ297zxZ-yDeexT1MrlSujVOflHCehf_CZoFDW5rqgse6TX55xZsAgN6Q7JgFhcbLdDZlNKFGaLkFrPMIqtYBs6WtqZNEml8cm3bvQYA May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:33:54.564490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de55d649ff94599ae5dd076719b438f"}]}] May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: eea376d0ec0b45958d63f7a94312d689 May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {"volumeAttachment": {"volumeId": "b4c29db9-32a6-462c-9a32-24fb482b45b8"}} May 09 18:33:54.566056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Cannot 'attach_volume' instance f4246c50-6390-4bc7-80e5-1af76bf497d8 while it is in vm_state rescued May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': 'f4246c50-6390-4bc7-80e5-1af76bf497d8', 'body': {'volumeAttachment': {'volumeId': 'b4c29db9-32a6-462c-9a32-24fb482b45b8'}}} May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:54.566904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f4246c50-6390-4bc7-80e5-1af76bf497d8 while it is in vm_state rescued May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:54.568320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:54.569607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:54.569607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:54.569607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f4246c50-6390-4bc7-80e5-1af76bf497d8 while it is in vm_state rescued May 09 18:33:54.569607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:33:54.577006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Returning 409 to user: Cannot 'attach_volume' instance f4246c50-6390-4bc7-80e5-1af76bf497d8 while it is in vm_state rescued {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:54.578998 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a2666b6f-62ee-4f67-a756-6c57f4999cad tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060635 May 09 18:33:54.580730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 176/333] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:33:54 2022] POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 18:33:54.589816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:54.590356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.597040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.601264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.603936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.606087 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.635420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.636129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.654087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.660748 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.661602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.666972 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.763422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-62c53d19-bc83-4155-8411-2912fcce0f33 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/action" status: 202 len: 0 microversion: 2.1 time: 0.177315 May 09 18:33:54.767850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 158/334] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:33:54 2022] POST /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:33:54.792755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-6e066ce1-18cc-4ea6-a412-7f81f326c6ad req-a8633fa5-fcaa-4224-9eef-53f52275700e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "name": "network-vif-plugged", "status": "completed", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:54.813900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6e066ce1-18cc-4ea6-a412-7f81f326c6ad req-a8633fa5-fcaa-4224-9eef-53f52275700e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.818739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6e066ce1-18cc-4ea6-a412-7f81f326c6ad req-a8633fa5-fcaa-4224-9eef-53f52275700e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.856364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-6e066ce1-18cc-4ea6-a412-7f81f326c6ad req-a8633fa5-fcaa-4224-9eef-53f52275700e service nova] Creating event network-vif-plugged:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:33:54.869337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-6e066ce1-18cc-4ea6-a412-7f81f326c6ad req-a8633fa5-fcaa-4224-9eef-53f52275700e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099436 May 09 18:33:54.881075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 159/335] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:54.887612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.897164 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.913042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.919480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.920688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.921244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.927058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:54.937266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8549530b-373c-43c3-a442-d76c7fb54325 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.311308 May 09 18:33:54.938267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 177/336] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:54.995157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.996489 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:55.015320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.017323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.020667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.024308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.377787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:55.389926 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:55.398245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-80b7540a-23f7-40cf-a186-af1db2d1b2af tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.444848 May 09 18:33:55.398509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9ed94072-a4cb-4c28-80dd-1892dab34033 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1509 microversion: 2.1 time: 0.515139 May 09 18:33:55.399054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 178/337] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:55.400465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 160/338] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:55.404579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-d86599ec-c018-4666-a622-18703b597bd2 req-5e8f0815-acb2-4c09-ad28-18fb3ea66e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b93a72-ed01-4edf-a96c-6fcb0391b356", "tag": "8391f7b3-cffe-4373-bead-c992b951b03f"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:55.411518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:55.412906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:55.413537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-d86599ec-c018-4666-a622-18703b597bd2 req-5e8f0815-acb2-4c09-ad28-18fb3ea66e09 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.414145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-d86599ec-c018-4666-a622-18703b597bd2 req-5e8f0815-acb2-4c09-ad28-18fb3ea66e09 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.424995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.425642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.426866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.427434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.428024 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-d86599ec-c018-4666-a622-18703b597bd2 req-5e8f0815-acb2-4c09-ad28-18fb3ea66e09 service nova] Creating event network-changed:8391f7b3-cffe-4373-bead-c992b951b03f for instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 on hv-cinder-83588 May 09 18:33:55.433113 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-d86599ec-c018-4666-a622-18703b597bd2 req-5e8f0815-acb2-4c09-ad28-18fb3ea66e09 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 May 09 18:33:55.433961 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 179/339] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:55.570916 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:55.579266 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f2c88fce-2bd2-4670-ba61-dc2f11f7b43d tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.176857 May 09 18:33:55.579848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 161/340] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:55 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:55.956274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:55.957203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:55.964893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.965524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.966443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.966902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.121523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:56.131402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-941f26d7-d011-4efb-a9f5-e3c0509e5014 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.179767 May 09 18:33:56.142508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 180/341] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:55 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:56.427529 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:56.428465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:56.429007 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:56.429908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:56.435074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.435535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.436729 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.437055 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.438773 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.439437 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.440606 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.441168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.657488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:56.672550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e108970e-b7f7-40ce-a7ed-4113b4615638 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1359 microversion: 2.1 time: 0.251174 May 09 18:33:56.673763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 162/342] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:56 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:56.679398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:56.681697 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:56.682776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:56.693028 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.693892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.695217 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.695401 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-192463cf-6519-455b-9998-cf8b3ae34fc7 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1509 microversion: 2.1 time: 0.272081 May 09 18:33:56.696212 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.696994 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 181/343] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:56 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:56.859450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:56.870254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-118ab606-3766-466f-9799-99a40170756e tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.194536 May 09 18:33:56.871135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 163/344] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:56 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:57.153700 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:57.155644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:57.166678 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-a5b61f79-0eaa-4c67-aad5-60249169a988 req-aeed3404-f37e-4c60-9fb8-a509172b551d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea408f-3c1f-424f-9688-eca90b44afcc", "name": "network-vif-plugged", "status": "completed", "tag": "b774a5f3-3a33-47b9-8f8e-92e04b9e57c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:57.167975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.169048 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.170852 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.172315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.206952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-a5b61f79-0eaa-4c67-aad5-60249169a988 req-aeed3404-f37e-4c60-9fb8-a509172b551d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.210337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-a5b61f79-0eaa-4c67-aad5-60249169a988 req-aeed3404-f37e-4c60-9fb8-a509172b551d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.234720 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-a5b61f79-0eaa-4c67-aad5-60249169a988 req-aeed3404-f37e-4c60-9fb8-a509172b551d service nova] Creating event network-vif-plugged:b774a5f3-3a33-47b9-8f8e-92e04b9e57c4 for instance b1ea408f-3c1f-424f-9688-eca90b44afcc on hv-cinder-83588 May 09 18:33:57.243754 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-a5b61f79-0eaa-4c67-aad5-60249169a988 req-aeed3404-f37e-4c60-9fb8-a509172b551d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084774 May 09 18:33:57.245589 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 164/345] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:57.426527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:57.437792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d4d45c90-bb02-42d5-a273-b20e59af0938 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.292657 May 09 18:33:57.438649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 182/346] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:57 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:57.702193 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:57.704691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:57.714294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:57.715319 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:57.723985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.727658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.728709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.729044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.729665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.730293 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:57.734806 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:57.735400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.004955 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.017344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42467adc-ff9b-4233-a7e2-c049bee7f2fc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1549 microversion: 2.1 time: 0.322357 May 09 18:33:58.018244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 165/347] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:57 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1549 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:58.020282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.033005 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:58.033520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-51d24e3e-dd56-494d-a5c1-9517686c73d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1509 microversion: 2.1 time: 0.323071 May 09 18:33:58.033977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:58.035101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 183/348] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:57 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:58.042353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:58.043640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.043838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:58.044980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.046507 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.047154 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.051061 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.051580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.052450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.053018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.250756 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.255018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.258366 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d12f3ba9-6ede-4a8c-8a6b-4b8187563169 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.238506 May 09 18:33:58.258994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 166/349] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:58 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:58.266871 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-94ed792c-fcb9-42fd-b087-6b05ca3e401c tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1549 microversion: 2.1 time: 0.230115 May 09 18:33:58.267688 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 184/350] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:58 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1549 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:58.283812 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:58.287261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.288058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Searching by: {'deleted': False, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2'} {{(pid=118350) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 18:33:58.297009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.297009 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.297459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.297897 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.406130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.multi_cell_list [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118350) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 18:33:58.461190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:58.461988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:58.473534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.473534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.473534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.473534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.529731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-102da91d-6287-4bef-aa87-422af3bf9e83 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.249649 May 09 18:33:58.530249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 167/351] 10.222.0.35 () {58 vars in 1124 bytes} [Mon May 9 18:33:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:58.541670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:58.542295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:58.548425 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.548894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.549666 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.550259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.650168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.663085 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-dede6919-5c7a-4e38-b207-439b2406c078 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.206304 May 09 18:33:58.663651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 185/352] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:58 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:58.715376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:58.723837 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0fa5c8bf-5a32-4634-a54a-768ad69f8a98 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1549 microversion: 2.1 time: 0.186816 May 09 18:33:58.724460 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 168/353] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:58 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:59.053506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:59.054126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:59.062473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.063289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.064105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.064640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.279991 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:59.285810 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:59.287045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:59.290246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-099c8050-8d11-47ab-968f-fff31032516b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1509 microversion: 2.1 time: 0.241566 May 09 18:33:59.291270 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 186/354] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:59 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:59.301480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.302507 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.304091 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.305630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.530711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:59.539338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fc96c391-83b2-475d-90a0-dc723516b843 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.264699 May 09 18:33:59.539993 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 169/355] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:59 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:59.681497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:59.682149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:59.688781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.689232 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.690013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:59.690445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:59.822137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:59.830059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-cff7f46f-f42f-4495-af13-04f277e71163 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.153296 May 09 18:33:59.830823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 187/356] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:33:59 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:00.307473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:00.308088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:00.315104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.315555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.316371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.316808 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.471831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:00.486404 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-967153cc-6d70-4cdf-b435-2ce01a4a9702 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1515 microversion: 2.1 time: 0.182405 May 09 18:34:00.503019 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 170/357] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:00 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:00.560571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:00.561657 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:00.572735 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.573875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.576091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.578161 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.607816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0095ef47-82cd-4b84-b48e-9188b2fae528"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:00.610079 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:00.622041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.623042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.625396 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.625973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.764566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:00.774573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b186cf0d-4cd4-42e7-8e88-1dbca828e1c3 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1315 microversion: 2.1 time: 0.219575 May 09 18:34:00.775285 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 188/358] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:00 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:00.847746 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:00.848594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:00.857118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.857809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:00.859345 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:00.860023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:01.259361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:01.267129 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5f9156df-4872-4c29-924a-76a55a757495 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.424119 May 09 18:34:01.267683 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 189/359] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:00 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:01.433095 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f0e79116-5fe6-42f6-a545-f1e1b78fec71 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834370 May 09 18:34:01.433760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 171/360] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:34:00 2022] POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:01.796587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:01.797614 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:01.803983 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:01.804457 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:01.805369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:01.805796 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:01.942093 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:01.949935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ab1684a9-3f75-4e65-9f3c-755bf9bfd33f tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1464 microversion: 2.1 time: 0.157831 May 09 18:34:01.950500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 190/361] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:01 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:01.950858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-49bd87c1-5569-4267-8609-047c67255d54 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: .version_select at 0x7fe8bacad3a0>, body: {"keypair": {"name": "tempest-keypair-292839750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjl4U8+HM8j0RER9mTBVm+u+QH+iRRc44ZKcXzzrSCcBk3BbOWPLjhPK9Zp3GYQIcXHQ/NGLcDu0aBz2LFxVokVAlzZuQA4GBJfXSfTObUX2V2k6x6XQk1lkbTCFksf5w=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:01.970457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-49bd87c1-5569-4267-8609-047c67255d54 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for project 7de55d649ff94599ae5dd076719b438f. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:01.976723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-49bd87c1-5569-4267-8609-047c67255d54 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for user eea376d0ec0b45958d63f7a94312d689 and project 7de55d649ff94599ae5dd076719b438f. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:02.006719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:02.007251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:02.010668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-49bd87c1-5569-4267-8609-047c67255d54 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065280 May 09 18:34:02.011432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 172/362] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:34:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:02.014675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.015123 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.015921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.016366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.054018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:02.140943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9b82dd2e-564b-42f1-8b10-c5ce81b944d7 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 204 len: 0 microversion: 2.1 time: 0.137613 May 09 18:34:02.142743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 191/363] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:34:02 2022] DELETE /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:34:02.155483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:02.156603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:02.173366 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.173993 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.175371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.176376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.289850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:02.291356 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:02.302387 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.303051 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.304529 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.305358 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.423364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:02.445340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8d997455-c0bc-4d22-a946-91a6335d5ec4 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1470 microversion: 2.1 time: 0.295748 May 09 18:34:02.447061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 173/364] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:02 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:02.520047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:02.531421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-37c76d55-809d-4a85-ba52-d901e047857f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.250029 May 09 18:34:02.532520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 192/365] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:02 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:02.595411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-a5e4feb3-8de2-4e77-be5b-ebbc8c1a2c10 req-6bd3652f-35b4-48e7-a0e6-344e0e7ff0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b93a72-ed01-4edf-a96c-6fcb0391b356", "name": "network-vif-plugged", "status": "completed", "tag": "8391f7b3-cffe-4373-bead-c992b951b03f"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:02.606015 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-a5e4feb3-8de2-4e77-be5b-ebbc8c1a2c10 req-6bd3652f-35b4-48e7-a0e6-344e0e7ff0df service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:02.607150 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-a5e4feb3-8de2-4e77-be5b-ebbc8c1a2c10 req-6bd3652f-35b4-48e7-a0e6-344e0e7ff0df service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:02.625275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-a5e4feb3-8de2-4e77-be5b-ebbc8c1a2c10 req-6bd3652f-35b4-48e7-a0e6-344e0e7ff0df service nova] Creating event network-vif-plugged:8391f7b3-cffe-4373-bead-c992b951b03f for instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 on hv-cinder-83588 May 09 18:34:02.634643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-a5e4feb3-8de2-4e77-be5b-ebbc8c1a2c10 req-6bd3652f-35b4-48e7-a0e6-344e0e7ff0df service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043151 May 09 18:34:02.635635 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 174/366] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:03.464456 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:03.465621 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:03.480547 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:03.481476 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:03.482842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:03.483503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:03.554543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:03.555328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:03.565006 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:03.565458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:03.566227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:03.566690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:03.795073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:03.802739 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-511c8311-99f8-4c3d-96fc-3f8be3e907ff tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1470 microversion: 2.1 time: 0.343063 May 09 18:34:03.803331 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 193/367] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:03 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:03.808614 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1878552446", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9801f3-b3d5-45d8-8351-8d5d5f5ffdea"}], "security_groups": [{"name": "tempest-securitygroup--1214034284"}], "key_name": "tempest-keypair-292839750", "user_data": "}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:03.818732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:03.826246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f6b8fc5d-c7c4-4195-a2be-e185f6a8fb0e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.276342 May 09 18:34:03.827354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 175/368] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:03 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:03.914701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] validate_networks() for [('4c9801f3-b3d5-45d8-8351-8d5d5f5ffdea', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:34:04.524878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:34:04.525472 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:34:04.525783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:34:04.526709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:34:04.527119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:34:04.542330 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.552597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.553552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.554008 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.591599 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:04.596281 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Getting quotas for user eea376d0ec0b45958d63f7a94312d689 and project 7de55d649ff94599ae5dd076719b438f. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:04.612366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:34:04.614985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:34:04.616392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-0199ee0b-994a-491e-9331-a92f7e740265 req-636a6c59-e4eb-47af-b5f3-7ba1d9ca62d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea408f-3c1f-424f-9688-eca90b44afcc", "name": "network-vif-deleted", "tag": "b774a5f3-3a33-47b9-8f8e-92e04b9e57c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:04.625224 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0199ee0b-994a-491e-9331-a92f7e740265 req-636a6c59-e4eb-47af-b5f3-7ba1d9ca62d7 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.625674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0199ee0b-994a-491e-9331-a92f7e740265 req-636a6c59-e4eb-47af-b5f3-7ba1d9ca62d7 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.640729 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-0199ee0b-994a-491e-9331-a92f7e740265 req-636a6c59-e4eb-47af-b5f3-7ba1d9ca62d7 service nova] Creating event network-vif-deleted:b774a5f3-3a33-47b9-8f8e-92e04b9e57c4 for instance b1ea408f-3c1f-424f-9688-eca90b44afcc on hv-cinder-83588 May 09 18:34:04.645540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-0199ee0b-994a-491e-9331-a92f7e740265 req-636a6c59-e4eb-47af-b5f3-7ba1d9ca62d7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 May 09 18:34:04.649434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 176/369] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:04.684282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a0b7e791-3420-4f86-b2a2-1172adfc4007 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.879859 May 09 18:34:04.685117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 194/370] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:34:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:34:04.701195 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e37393b1-7fc7-4a98-ac08-b56eaa25dff4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:04.710523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e37393b1-7fc7-4a98-ac08-b56eaa25dff4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:04.770463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e37393b1-7fc7-4a98-ac08-b56eaa25dff4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:04.780052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e37393b1-7fc7-4a98-ac08-b56eaa25dff4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1245 microversion: 2.1 time: 0.088353 May 09 18:34:04.792906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 177/371] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:04 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:04.822396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:04.823109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:04.830240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.830611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.831391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.831827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.842833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:04.843454 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:04.850122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.850528 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.851245 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.851827 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.867916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:04.868569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:04.869116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lazy-loading 'fault' on Instance uuid b1ea408f-3c1f-424f-9688-eca90b44afcc {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:04.937724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5873d67cd3848c2a8efc5006d7ee9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50df5bb816524124bd71f9365a2249bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:04.947361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9a29de26-8d21-436e-8a4c-302014f30202 tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 200 len: 1305 microversion: 2.1 time: 0.129947 May 09 18:34:04.948279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 195/372] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:04 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:05.019921 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:05.027851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7bcf2ec1-2c00-478c-951f-8323cc836cf8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1366 microversion: 2.1 time: 0.188916 May 09 18:34:05.028472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 178/373] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:04 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:05.802868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:05.803878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:05.817024 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:05.817471 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:05.818637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:05.819073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:05.896054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:05.905254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9d86e7db-d8d9-47c6-9307-eb2a1b775e16 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1241 microversion: 2.1 time: 0.106826 May 09 18:34:05.905852 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 196/374] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:05 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:05.965339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:05.965910 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] [instance: b1ea408f-3c1f-424f-9688-eca90b44afcc] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:05.973594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:05.974042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:05.974881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:05.975355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:05.991330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] HTTP exception thrown: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Request method failure captured: May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc HTTP/1.1 May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV53DYwiEMoQghh4l31TDf_x1Z5HXKv74nuZgTl-3lmg2qkaaiISlPGS6atv_djMYfj8SN_VhNtSQWT7TzRlLnuYcJ2OPunvMtNA-yj78feZDClIf6vMJpSEM6qvVTVdxGDU7j1SFHQsXROqFq9HFbPjRHeFFRZLNzvhJqMsKbxa3bU May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 50df5bb816524124bd71f9365a2249bf May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesNegativeTest-335599622 May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:34:05.993124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/50df5bb816524124bd71f9365a2249bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/50df5bb816524124bd71f9365a2249bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/50df5bb816524124bd71f9365a2249bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_50df5bb816524124bd71f9365a2249bf"}]}] May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesNegativeTest-335599622 May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 50df5bb816524124bd71f9365a2249bf May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesNegativeTest-335599622 May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesNegativeTest-335599622-project May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: b5873d67cd3848c2a8efc5006d7ee9af May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesNegativeTest-335599622-project May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. May 09 18:34:05.994870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'b1ea408f-3c1f-424f-9688-eca90b44afcc'} May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:05.995763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. May 09 18:34:05.997241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:34:05.998561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] Returning 404 to user: Instance b1ea408f-3c1f-424f-9688-eca90b44afcc could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:05.998561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e1df2201-6e8a-468e-9c62-6b702846131b tempest-VolumesNegativeTest-335599622 tempest-VolumesNegativeTest-335599622-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc" status: 404 len: 111 microversion: 2.1 time: 0.033459 May 09 18:34:05.998561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 179/375] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:05 2022] GET /compute/v2.1/servers/b1ea408f-3c1f-424f-9688-eca90b44afcc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:34:06.046449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:06.046592 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:06.052827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.053292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:06.054074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.054499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:06.189612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:06.197649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a2e2cba1-8de1-4434-ad72-9cbcf927df05 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1556 microversion: 2.1 time: 0.155953 May 09 18:34:06.198352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 197/376] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:06 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:06.216471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:06.217323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:06.224002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.224840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:06.226213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.226777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:06.380001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5c5316e5-76f7-472c-acce-d4ba9b1b8da1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168776 May 09 18:34:06.381417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 180/377] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:34:06 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:06.930411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:06.931097 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:06.937533 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.937975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:06.938944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:06.939531 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:07.023566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:07.033995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-04a7c4d9-87db-44bc-904c-b11481bac690 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1303 microversion: 2.1 time: 0.114632 May 09 18:34:07.034825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 198/378] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:06 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:07.560155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-7ef2f9e9-a82e-4b4f-b20a-7ba7078abee4 req-4a38de50-4e01-455f-87bf-bfd765f3bd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b93a72-ed01-4edf-a96c-6fcb0391b356", "tag": "8391f7b3-cffe-4373-bead-c992b951b03f"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:07.583603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-7ef2f9e9-a82e-4b4f-b20a-7ba7078abee4 req-4a38de50-4e01-455f-87bf-bfd765f3bd59 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:07.584357 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-7ef2f9e9-a82e-4b4f-b20a-7ba7078abee4 req-4a38de50-4e01-455f-87bf-bfd765f3bd59 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:07.600165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-7ef2f9e9-a82e-4b4f-b20a-7ba7078abee4 req-4a38de50-4e01-455f-87bf-bfd765f3bd59 service nova] Creating event network-changed:8391f7b3-cffe-4373-bead-c992b951b03f for instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 on hv-cinder-83588 May 09 18:34:07.605959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-7ef2f9e9-a82e-4b4f-b20a-7ba7078abee4 req-4a38de50-4e01-455f-87bf-bfd765f3bd59 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051279 May 09 18:34:07.608132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 181/379] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:08.056762 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:08.058385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:08.077267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.078191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.082084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.092839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.501172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:08.509530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-50cc48b8-5245-40b9-838b-3b02df2b2a34 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.460828 May 09 18:34:08.510793 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 199/380] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:08 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:08.585579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-b7971845-929b-4959-801d-ba4ba46482f5 req-3c5b5cd1-f90c-4157-ae8f-e3a70354b345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:08.600103 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b7971845-929b-4959-801d-ba4ba46482f5 req-3c5b5cd1-f90c-4157-ae8f-e3a70354b345 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.600545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b7971845-929b-4959-801d-ba4ba46482f5 req-3c5b5cd1-f90c-4157-ae8f-e3a70354b345 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.626011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-b7971845-929b-4959-801d-ba4ba46482f5 req-3c5b5cd1-f90c-4157-ae8f-e3a70354b345 service nova] Creating event network-changed:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:34:08.634042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-b7971845-929b-4959-801d-ba4ba46482f5 req-3c5b5cd1-f90c-4157-ae8f-e3a70354b345 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050202 May 09 18:34:08.635044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 182/381] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:09.279092 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:09.280597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:09.288296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.288744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.289661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.290095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.490271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:09.499293 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c5b491a2-745a-44aa-b33c-72288ac6c1fb tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1595 microversion: 2.1 time: 0.224525 May 09 18:34:09.499871 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 200/382] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:09 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1595 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:09.528756 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:09.529445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:09.536148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.536700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.537563 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.538077 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.679516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:09.687375 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a172d515-40c5-4e68-9f58-388892072cdf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.163128 May 09 18:34:09.697063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 183/383] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:09 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:10.704600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:10.705229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:10.711429 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:10.711806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:10.712710 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:10.713144 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:11.015283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:11.031916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8bec680f-a84d-4c7c-85e5-b62209e09284 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.327446 May 09 18:34:11.032655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 201/384] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:10 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:12.050828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:12.051531 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:12.058710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.059232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.060285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.060782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.282015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-4c0cec01-9bf6-4cd3-8eab-dc6577ea6e6a req-205dc043-1956-49a6-a49a-f67a3249a6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:12.299072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-4c0cec01-9bf6-4cd3-8eab-dc6577ea6e6a req-205dc043-1956-49a6-a49a-f67a3249a6e4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.299777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-4c0cec01-9bf6-4cd3-8eab-dc6577ea6e6a req-205dc043-1956-49a6-a49a-f67a3249a6e4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.315800 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:12.316487 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-4c0cec01-9bf6-4cd3-8eab-dc6577ea6e6a req-205dc043-1956-49a6-a49a-f67a3249a6e4 service nova] Creating event network-changed:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:34:12.326093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ab34374d-8165-4fbf-8a2c-564ecb834354 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.279082 May 09 18:34:12.326641 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 184/385] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:12 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:12.327269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-4c0cec01-9bf6-4cd3-8eab-dc6577ea6e6a req-205dc043-1956-49a6-a49a-f67a3249a6e4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048644 May 09 18:34:12.328124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 202/386] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:13.342632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:13.343250 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:13.350097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.350547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.351882 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.352610 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.550563 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:13.560376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-83248337-a46e-4699-a2d5-1da1b36e494e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.221296 May 09 18:34:13.561550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 185/387] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:13 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:13.610284 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2017815047"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:13.612591 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:13.619854 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.620569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.621338 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.621908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.776243 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.network.security_group_api [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Adding security group dc1b843f-741c-40be-9252-90df23430358 to port 019a5ad8-184e-45fd-809a-48b4e4a491c4 May 09 18:34:14.144982 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-40e9c8fd-5486-4f0d-915d-0e178e7b7fd5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action" status: 202 len: 0 microversion: 2.1 time: 0.540049 May 09 18:34:14.145669 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 203/388] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:34:13 2022] POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:14.156825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:14.158679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:14.166262 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.166709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.167511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.168011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.336590 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:14.344566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-6b60214a-24e9-4644-9a3f-832b5b341af0 req-2a7947c1-b195-4b17-98ab-76cd84a59a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:14.351331 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cc4cea28-ecf7-4491-84a0-1bb15e6fcf75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1761 microversion: 2.1 time: 0.200752 May 09 18:34:14.353029 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 186/389] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:14 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1761 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:14.354777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6b60214a-24e9-4644-9a3f-832b5b341af0 req-2a7947c1-b195-4b17-98ab-76cd84a59a05 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.355217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6b60214a-24e9-4644-9a3f-832b5b341af0 req-2a7947c1-b195-4b17-98ab-76cd84a59a05 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.367897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-6b60214a-24e9-4644-9a3f-832b5b341af0 req-2a7947c1-b195-4b17-98ab-76cd84a59a05 service nova] Creating event network-changed:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:34:14.373282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-6b60214a-24e9-4644-9a3f-832b5b341af0 req-2a7947c1-b195-4b17-98ab-76cd84a59a05 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 May 09 18:34:14.373889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 204/390] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:14.579308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:14.580154 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:14.586558 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.587182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.588304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.588990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.759518 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-324716304", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "networks": [{"uuid": "7eb9cf46-1f88-4ffc-b1c8-4992a9de4725"}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:14.796724 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:14.804980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d3e62825-6eef-4ff3-b97d-16464392b300 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.230698 May 09 18:34:14.809990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 187/391] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:14 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:14.828680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] validate_networks() for [('7eb9cf46-1f88-4ffc-b1c8-4992a9de4725', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:34:15.027543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-318e7092-25dc-467e-8ae3-4388e15ecf41 req-5e41ee2d-1985-4144-988b-4bbfeb8c999e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "name": "network-vif-plugged", "status": "completed", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:15.037625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-318e7092-25dc-467e-8ae3-4388e15ecf41 req-5e41ee2d-1985-4144-988b-4bbfeb8c999e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:15.038316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-318e7092-25dc-467e-8ae3-4388e15ecf41 req-5e41ee2d-1985-4144-988b-4bbfeb8c999e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:15.051983 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-318e7092-25dc-467e-8ae3-4388e15ecf41 req-5e41ee2d-1985-4144-988b-4bbfeb8c999e service nova] Creating event network-vif-plugged:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:34:15.057988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-318e7092-25dc-467e-8ae3-4388e15ecf41 req-5e41ee2d-1985-4144-988b-4bbfeb8c999e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035955 May 09 18:34:15.058977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 188/392] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:15.352804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:34:15.353217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:34:15.353676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:34:15.354077 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:34:15.354474 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:34:15.364068 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:15.364506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:15.365299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:15.365719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:15.382925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Getting quotas for project d435ae0d74c84add84b2ea2293ef8284. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:15.386922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Getting quotas for user d373d38388d84c0e8b7ffdf992d08461 and project d435ae0d74c84add84b2ea2293ef8284. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:15.398371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:34:15.401113 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:34:15.450886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4d0701d2-9ddc-4eb0-8b07-3f4a8e3a8e39 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696306 May 09 18:34:15.451556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 205/393] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:34:15.462938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-34639a12-79d9-4860-a745-815c0ebc79c7 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:15.463721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-34639a12-79d9-4860-a745-815c0ebc79c7 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:15.518045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-34639a12-79d9-4860-a745-815c0ebc79c7 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:15.524805 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-34639a12-79d9-4860-a745-815c0ebc79c7 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1218 microversion: 2.1 time: 0.066587 May 09 18:34:15.525347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 189/394] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:15 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:15.826699 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:15.827415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:15.834067 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:15.834485 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:15.835253 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:15.835770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:15.984009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:15.995601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f0ad8273-6e93-4643-81c1-0aa074e3cdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.173065 May 09 18:34:15.996217 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 206/395] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:15 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:16.542754 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:16.543522 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:16.552023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:16.552487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:16.553254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:16.553709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:16.618950 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:16.626600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ff6e12e0-19be-4240-b000-0a21b9355cf0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1270 microversion: 2.1 time: 0.087929 May 09 18:34:16.627152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 190/396] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:16 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:17.014719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:17.015287 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:17.021801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:17.022252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:17.023020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:17.023454 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:17.163253 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:17.170941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7b9ae59b-980c-4cd2-a482-368d12bfe44c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1371 microversion: 2.1 time: 0.160568 May 09 18:34:17.171523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 207/397] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:17 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:17.646217 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:17.647600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:17.658924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:17.660671 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:17.662288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:17.663070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:17.742896 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:17.750436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6b254681-3600-4674-bae3-2e276013c70c tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1276 microversion: 2.1 time: 0.109800 May 09 18:34:17.751015 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 191/398] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:17 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:18.191227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:18.191925 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:18.198051 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.198513 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.199282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.199709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.392546 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:18.402806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9666caaa-fc66-48e4-9df9-224e93bf6b10 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1566 microversion: 2.1 time: 0.215720 May 09 18:34:18.403423 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 208/399] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:18 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:18.420581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:18.421078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:18.427798 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.428524 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.429409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.429925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.532657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a13d661a-1982-473a-92b4-5c35019ae27e tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116522 May 09 18:34:18.534242 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 192/400] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:34:18 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:18.766864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:18.768297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:18.774428 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.774885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.776368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.776706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.190698 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:19.199938 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b3144503-e502-4b40-b99f-9d50146578f6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.437048 May 09 18:34:19.205430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 209/401] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:18 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:19.303070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-e3859741-d714-42d2-a162-2063dc4459ca req-0ce02bbe-5ae2-42b1-ac33-452d6ac5e147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b85b34-2833-4601-a003-c3dbbd6a28ae", "tag": "8767fd17-d40b-4f1a-9b25-b098a6226b0d"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:19.313212 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e3859741-d714-42d2-a162-2063dc4459ca req-0ce02bbe-5ae2-42b1-ac33-452d6ac5e147 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:19.313651 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e3859741-d714-42d2-a162-2063dc4459ca req-0ce02bbe-5ae2-42b1-ac33-452d6ac5e147 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.325580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-e3859741-d714-42d2-a162-2063dc4459ca req-0ce02bbe-5ae2-42b1-ac33-452d6ac5e147 service nova] Creating event network-changed:8767fd17-d40b-4f1a-9b25-b098a6226b0d for instance 52b85b34-2833-4601-a003-c3dbbd6a28ae on hv-cinder-83588 May 09 18:34:19.330511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-e3859741-d714-42d2-a162-2063dc4459ca req-0ce02bbe-5ae2-42b1-ac33-452d6ac5e147 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031553 May 09 18:34:19.331434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 193/402] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:19.815254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-f1c18294-9711-4c32-ba8b-84023497dfa9 req-e1e256eb-97b2-4db1-b514-79c454d21c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:19.823937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f1c18294-9711-4c32-ba8b-84023497dfa9 req-e1e256eb-97b2-4db1-b514-79c454d21c25 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:19.824508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f1c18294-9711-4c32-ba8b-84023497dfa9 req-e1e256eb-97b2-4db1-b514-79c454d21c25 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.836173 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-f1c18294-9711-4c32-ba8b-84023497dfa9 req-e1e256eb-97b2-4db1-b514-79c454d21c25 service nova] Creating event network-changed:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:34:19.841385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-f1c18294-9711-4c32-ba8b-84023497dfa9 req-e1e256eb-97b2-4db1-b514-79c454d21c25 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029727 May 09 18:34:19.841970 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 210/403] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:20.218787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:20.219605 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:20.226211 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.226736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.227600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.228127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.364625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:20.372436 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3f513d2f-6d9f-4258-91b5-f69b4a8ad513 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.158014 May 09 18:34:20.372908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 194/404] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:20 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:21.392342 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:21.393150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:21.400058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.400469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.401658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.402305 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.540643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:21.548515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2c21fa6f-0116-48f4-b29e-6e1936c32e01 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.162247 May 09 18:34:21.549057 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 211/405] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:21 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:22.565908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:22.566488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:22.573108 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:22.573537 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:22.574336 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:22.574772 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:22.705346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:22.712640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2d4980c4-7eb1-4762-9420-48920a888b5f tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.150728 May 09 18:34:22.713200 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 195/406] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:22 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:23.730385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:23.730987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:23.737709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:23.738090 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:23.738864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:23.739302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:23.877638 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:23.885079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-881e4961-1ed3-4618-8ad6-90634659e0fb tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.158898 May 09 18:34:23.885725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 212/407] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:23 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:24.619806 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-b6bed176-41a6-4ea8-b25c-809578d5a632 req-dfdb33e2-cfe8-42de-a3f1-947e04c309c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b85b34-2833-4601-a003-c3dbbd6a28ae", "name": "network-vif-plugged", "status": "completed", "tag": "8767fd17-d40b-4f1a-9b25-b098a6226b0d"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:24.628535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b6bed176-41a6-4ea8-b25c-809578d5a632 req-dfdb33e2-cfe8-42de-a3f1-947e04c309c8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:24.628973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b6bed176-41a6-4ea8-b25c-809578d5a632 req-dfdb33e2-cfe8-42de-a3f1-947e04c309c8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:24.642172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-b6bed176-41a6-4ea8-b25c-809578d5a632 req-dfdb33e2-cfe8-42de-a3f1-947e04c309c8 service nova] Creating event network-vif-plugged:8767fd17-d40b-4f1a-9b25-b098a6226b0d for instance 52b85b34-2833-4601-a003-c3dbbd6a28ae on hv-cinder-83588 May 09 18:34:24.647118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-b6bed176-41a6-4ea8-b25c-809578d5a632 req-dfdb33e2-cfe8-42de-a3f1-947e04c309c8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 May 09 18:34:24.647716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 196/408] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:24.903015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:24.903693 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:24.910140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:24.910586 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:24.911456 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:24.911862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:25.040189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:25.048503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7a38aed5-760f-440a-a6f1-b1ca0890ebe4 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.149761 May 09 18:34:25.049086 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 213/409] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:24 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:26.071931 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:26.072593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:26.079508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.079936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.080752 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.081191 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.219314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:26.231312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-414c27e7-3807-4235-b6c5-0898c7a4f210 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1318 microversion: 2.1 time: 0.164023 May 09 18:34:26.232138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 197/410] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:26 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:27.258760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:27.259640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:27.267813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:27.268282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:27.269045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:27.269478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:27.408550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:27.416701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-967492f5-f64b-4927-9df7-7579410064b1 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1508 microversion: 2.1 time: 0.164599 May 09 18:34:27.417612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 214/411] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:27 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:44.717760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:44.719789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:44.730290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.731052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.732363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.733171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.814413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-30d164d5-8987-407e-890c-f2f8cb8c35c2 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action" status: 202 len: 0 microversion: 2.1 time: 0.107144 May 09 18:34:44.814931 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 198/412] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:34:44 2022] POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:44.823199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:44.823894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:44.830036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.830489 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.831258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.831697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.988776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:44.996839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5874addf-f504-4b74-ac61-9bbbc67266a1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1753 microversion: 2.1 time: 0.177601 May 09 18:34:44.997417 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 215/413] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:44 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:45.804701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e0e5d36-80c2-4445-b83c-210ac7552f7e", "device": "/dev/sdb"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:45.806393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:45.813330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.813766 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.814523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.814948 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.015362 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:46.016848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:46.023119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.024202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.025298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.025874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.085631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0107db0c-2379-4f89-8e2d-975ef29682b8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "POST /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285785 May 09 18:34:46.086277 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 199/414] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:34:45 2022] POST /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:46.173532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:46.182654 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3c55034d-83d8-4dc1-9edf-0766cc415693 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.171336 May 09 18:34:46.183243 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 216/415] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:46 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:47.201784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:47.202466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:47.209668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.210138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.210946 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.211373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.371852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:47.381109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-674b7a55-e976-4635-bb23-9aa8f6672e75 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.184403 May 09 18:34:47.381686 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 200/416] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:47 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:48.402990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:48.404004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:48.414845 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.415592 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.416946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.417661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.569367 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:48.577431 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8b874c0a-525b-471d-ba74-bd706a9c04e3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.181303 May 09 18:34:48.577987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 217/417] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:48 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:49.603697 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:49.604309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:49.615078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.615885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.617197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.617908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.771872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:49.783389 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-56b78178-efa9-4d7e-b39c-eb94aa7549c0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.185777 May 09 18:34:49.784486 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 201/418] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:49 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:50.810676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:50.811777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:50.818876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.819323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.820124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.820551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.983876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:50.997455 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5c359864-040d-4d73-a5e0-e6184f2a4dcc tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.193006 May 09 18:34:50.998342 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 218/419] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:50 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:52.015121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:52.015694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:52.024338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.025312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.026462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.027524 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.187022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:52.195287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7fd8366f-05ec-448d-bbf4-ae6c80342582 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.184164 May 09 18:34:52.195868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 202/420] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:52 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:53.213001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:53.213616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:53.219804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.220271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.221028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.221448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.362836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:53.373580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b3f2d83e-9088-43d6-be89-c52473356cac tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.164168 May 09 18:34:53.374496 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 219/421] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:53 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:54.397528 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.398219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.406470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.406994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.407894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.408447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.576786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:54.589931 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6789671a-4d52-40c9-aa0b-b0e87d1667dd tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.196536 May 09 18:34:54.590732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 203/422] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:54 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:55.612779 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:55.613792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:55.624452 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:55.625287 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:55.626424 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:55.626971 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:55.782126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:55.796101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3c214448-ff9d-455f-8bf6-b8e371d2187b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.189526 May 09 18:34:55.797015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 220/423] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:55 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:56.814384 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:56.814972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:56.821657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.822108 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.822868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.823300 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.973172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:56.987705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f4349ee6-102b-43ca-b5db-577f90fe8381 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.177011 May 09 18:34:56.989038 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 204/424] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:56 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:58.010043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:58.010910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:58.017448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.017829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.018605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.019038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.171098 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:58.183464 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4031292a-18d0-4ee6-992f-89675ef097d1 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.177064 May 09 18:34:58.184193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 221/425] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:58 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:59.206324 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:59.206960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:59.213780 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.214243 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.214995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.215420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.369920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:59.380143 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-47e3e48c-9bcf-4a70-8540-4edf15ece9f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.179807 May 09 18:34:59.380764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 205/426] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:34:59 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:00.400054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:00.400638 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:00.407930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.408601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.409380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.409815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.577338 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:00.585906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1c058768-f90b-4e16-b638-a73d87c04c21 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.190640 May 09 18:35:00.586494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 222/427] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:00 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:01.606189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:01.607150 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:01.617050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.617732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.618887 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.619549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.777711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:01.788388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-adac20a2-f21c-43ff-a28d-9ad5fe126305 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.188366 May 09 18:35:01.788946 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 206/428] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:01 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:02.815997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:02.817223 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:02.828278 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.829096 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:02.830494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.831282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:02.993997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:03.002283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-eabd6027-e46b-4c54-8aff-4ce6135ee0a3 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.193612 May 09 18:35:03.002864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 223/429] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:02 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:04.020683 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:04.021220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.029338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.029789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.030588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.031025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.128340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:04.128958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.135069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.135551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.136727 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.137159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.173636 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a0e04df8-755c-4b83-b38a-97b53383e40f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/ips" status: 200 len: 149 microversion: 2.1 time: 0.049341 May 09 18:35:04.174231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 224/430] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:35:04 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:35:04.185344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e117b71-42ac-44bb-970f-0216f529d766"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:04.185661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:04.186386 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.192508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.192955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.193741 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.194100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-27271ead-f8a1-4597-b11c-7e7aeadbc428 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.177732 May 09 18:35:04.194304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.194786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 207/431] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:04 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:04.282152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: POST /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/os-volume_attachments HTTP/1.1 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 74 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:35:04.283861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {"volumeAttachment": {"volumeId": "3e117b71-42ac-44bb-970f-0216f529d766"}} May 09 18:35:04.285500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': 'e5b93a72-ed01-4edf-a96c-6fcb0391b356', 'body': {'volumeAttachment': {'volumeId': '3e117b71-42ac-44bb-970f-0216f529d766'}}} May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:04.286596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:04.289157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 400 to user: Invalid volume: volume 3e117b71-42ac-44bb-970f-0216f529d766 is already attached to instances: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1dadeb65-9060-4fdc-84e7-a1c224431aa2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104517 May 09 18:35:04.291200 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 225/432] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:35:04 2022] POST /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 18:35:04.296843 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:04.297345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.303484 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.303935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.304766 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.305202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.329994 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:35:04.407858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b884c7d5-f2f3-4f22-8f28-bcb52a25a75c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 204 len: 0 microversion: 2.1 time: 0.114576 May 09 18:35:04.408491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 208/433] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:35:04 2022] DELETE /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:35:04.417376 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:04.418246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.426402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.426847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.427644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.428136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.562657 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:04.570258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-929349fa-ce26-4f08-af5b-d31da13c3f00 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1680 microversion: 2.1 time: 0.157351 May 09 18:35:04.570824 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 226/434] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:04 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:05.217130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:05.217890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:05.224918 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.225370 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.226157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.226583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.376352 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:05.385151 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-88351a15-a748-42f6-8389-55e269a1105f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.175184 May 09 18:35:05.385749 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 209/435] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:05 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:05.595405 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:05.596106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:05.602976 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.603499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.604298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.604713 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.748012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:05.759010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-01aeccb4-4ddf-42f8-97b5-3fe557492f08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1680 microversion: 2.1 time: 0.167629 May 09 18:35:05.759911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 227/436] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:05 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:06.403153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:06.403762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:06.410640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.411084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.411868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.412343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.584869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:06.593648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-de017cdf-8168-4066-9afc-3bae2e2b1767 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.194713 May 09 18:35:06.594236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 210/437] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:06 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:06.778368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:06.778929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:06.784924 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.785348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.786123 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.786619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.916370 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:06.924138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-db80339a-5990-42f9-adb4-1e236da4c5a9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1680 microversion: 2.1 time: 0.150698 May 09 18:35:06.924719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 228/438] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:06 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:07.613138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:07.613889 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:07.620716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.621179 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.621984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.622412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.806157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:07.815126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1e8c77c7-ca37-4b03-97c7-77474a1ca6d5 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.206317 May 09 18:35:07.815761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 211/439] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:07 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:07.942577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:07.943204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:07.949874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.956409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.957535 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.957975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:08.024578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:08.035193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-489f86ec-2310-47ad-a387-8b8c77a86410 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1613 microversion: 2.1 time: 0.097070 May 09 18:35:08.035877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 229/440] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:07 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:08.250203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-c2dbb84d-da76-4c55-89be-d0f6a4888759 req-176fe269-6571-4de1-9c0d-728d24b10bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b93a72-ed01-4edf-a96c-6fcb0391b356", "name": "network-vif-deleted", "tag": "8391f7b3-cffe-4373-bead-c992b951b03f"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:08.258927 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c2dbb84d-da76-4c55-89be-d0f6a4888759 req-176fe269-6571-4de1-9c0d-728d24b10bec service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:08.259590 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c2dbb84d-da76-4c55-89be-d0f6a4888759 req-176fe269-6571-4de1-9c0d-728d24b10bec service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:08.274557 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-c2dbb84d-da76-4c55-89be-d0f6a4888759 req-176fe269-6571-4de1-9c0d-728d24b10bec service nova] Creating event network-vif-deleted:8391f7b3-cffe-4373-bead-c992b951b03f for instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 on hv-cinder-83588 May 09 18:35:08.280372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-c2dbb84d-da76-4c55-89be-d0f6a4888759 req-176fe269-6571-4de1-9c0d-728d24b10bec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033961 May 09 18:35:08.281625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 212/441] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:08.833885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:08.834913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:08.843999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:08.844960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:08.845966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:08.846742 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.033107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:09.041313 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1f98cde0-b324-4d6f-9134-3807fe6fb797 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.212094 May 09 18:35:09.042667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 230/442] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:08 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:09.054229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:09.054906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:09.062815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.063255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.064309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.064747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.110001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.110707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.111398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'fault' on Instance uuid e5b93a72-ed01-4edf-a96c-6fcb0391b356 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:09.185741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:09.193691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-66170c80-8cf3-4ef7-8b36-35afda5b81b4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 200 len: 1331 microversion: 2.1 time: 0.144619 May 09 18:35:09.194609 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 213/443] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:09 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:09.941834 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:09.942333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:09.949047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.949411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.950186 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.950617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:10.058818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:10.059471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:10.066452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:10.067228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:10.068056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:10.068826 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:10.079359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lazy-loading 'services' on Instance uuid 52b85b34-2833-4601-a003-c3dbbd6a28ae {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:10.198788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-829cde74-ede3-418f-8091-68fd3c656724 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "DELETE /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae/os-volume_attachments/9e0e5d36-80c2-4445-b83c-210ac7552f7e" status: 202 len: 0 microversion: 2.1 time: 0.260814 May 09 18:35:10.199923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 231/444] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:35:09 2022] DELETE /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae/os-volume_attachments/9e0e5d36-80c2-4445-b83c-210ac7552f7e => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:35:10.211324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:10.212071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:10.218493 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:10.219182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:10.220383 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:10.220908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:10.223700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:10.235268 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:35:10.235503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-54894fc3-99bb-4c9a-bfc6-32820e52cb79 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.180482 May 09 18:35:10.236382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 214/445] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:10 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 HTTP/1.1 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:35:10.237128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:35:10.238712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'e5b93a72-ed01-4edf-a96c-6fcb0391b356'} May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:10.239443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:35:10.241211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:10.242985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:10.242985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-86c5908d-6af6-462e-a743-d1542962e7b7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 404 len: 111 microversion: 2.1 time: 0.031692 May 09 18:35:10.243360 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 232/446] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:10 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 18:35:10.250258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9a30ff42-2676-4bb9-803d-3d0c270bd45c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '.version_select at 0x7fe8bacad1f0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:10.280638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9a30ff42-2676-4bb9-803d-3d0c270bd45c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834098930" status: 202 len: 0 microversion: 2.1 time: 0.035746 May 09 18:35:10.281320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 215/447] 10.222.0.35 () {58 vars in 1220 bytes} [Mon May 9 18:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834098930 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:35:11.249140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.249701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.254155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.254754 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.256042 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.256509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.257297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.257725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.260979 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.261452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.264382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.264382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.346588 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'services' on Instance uuid 8fe2046a-655a-4a12-ad29-1427fa1d4f9a {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:11.420148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:11.430093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-193b07b7-1f08-465d-a27f-34fcadbc9a8b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.180241 May 09 18:35:11.430576 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7fc581c4-04d9-44fc-b021-d817d5c60364 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments/3e117b71-42ac-44bb-970f-0216f529d766" status: 202 len: 0 microversion: 2.1 time: 0.185331 May 09 18:35:11.431008 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 216/448] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:11 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:11.435214 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 233/449] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:35:11 2022] DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments/3e117b71-42ac-44bb-970f-0216f529d766 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:35:11.435562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.436121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.444692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.445146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.446319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.446852 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.452621 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.453743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.465034 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.472355 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.473294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.473760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.478380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:35:11.517133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-677e7f1c-667a-46d0-a6d1-3f1b1558e0c2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080089 May 09 18:35:11.517736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 234/450] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:35:11 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:11.570177 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d345a7b8-af59-47ea-9f1f-2f12a35d0264 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "DELETE /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 204 len: 0 microversion: 2.1 time: 0.137927 May 09 18:35:11.570841 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 217/451] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:35:11 2022] DELETE /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:35:11.579193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.579845 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.585848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.586296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.587063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.587608 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.727456 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:11.735103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-67395a50-c852-4a59-95f9-a06187a8c14e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1514 microversion: 2.1 time: 0.159793 May 09 18:35:11.735679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 235/452] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:11 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:12.447410 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:12.448152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:12.454817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.455268 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.456062 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.456489 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.530235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:12.531301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:12.538152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.538600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.539385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.539820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.570529 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3838d003-03dc-4f8b-8582-98a7648746d5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 May 09 18:35:12.571081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 236/453] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:35:12 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:12.603371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:12.611527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b5e43ad2-6831-4b1e-8e0f-186864c26328 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.168306 May 09 18:35:12.612136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 218/454] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:12 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:12.757252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:12.758192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:12.765042 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.765483 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.766239 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:12.766658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:12.899847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:12.907418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9761a56e-fe29-484a-a48d-bec0f76ee5b0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1514 microversion: 2.1 time: 0.157551 May 09 18:35:12.907985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 237/455] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:12 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:13.583055 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:13.584070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:13.591205 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.591654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.592476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.592911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.628246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b4767fc2-bbad-4970-8d6a-6380927fac08 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 May 09 18:35:13.628246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 219/456] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:35:13 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:13.629731 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:13.630501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:13.637254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.637706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.638493 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.638918 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.793197 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:13.804182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-03ab4058-e08f-42b0-86ae-1cf5988b3d53 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1758 microversion: 2.1 time: 0.178769 May 09 18:35:13.804788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 238/457] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:13 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:13.929292 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:13.930293 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:13.938616 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.939100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.947832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.947832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.087041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:14.096366 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7768febd-2eb1-4bab-8141-49962e6ad837 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1514 microversion: 2.1 time: 0.173546 May 09 18:35:14.096972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 220/458] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:13 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:14.638340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:14.639263 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:14.645612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.646059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.646830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.647255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.681561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7f04ed9b-56c2-42dc-815d-00da02853079 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047275 May 09 18:35:14.682640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 239/459] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:35:14 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:35:14.740472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:14.741553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:14.748082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.748536 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.749310 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.749746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.775475 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:35:14.823449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:14.824524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:14.847435 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.848186 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.850169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.850818 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.860908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-21e1dbaa-70c7-43b0-9d2c-42cf40cfd22f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 204 len: 0 microversion: 2.1 time: 0.123706 May 09 18:35:14.861511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 221/460] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:35:14 2022] DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:35:14.870678 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:14.871376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:14.880644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.880644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.880644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.880644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.073733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.076638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.081861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-00e23df9-aa0f-418c-8502-cb085186b148 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1761 microversion: 2.1 time: 0.262737 May 09 18:35:15.082442 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 240/461] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:14 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1761 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:15.084359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f053b3ae-067a-41c0-9ece-01e5e2de157d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1682 microversion: 2.1 time: 0.218365 May 09 18:35:15.084923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 222/462] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:14 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:15.092076 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-f3a7c36e-f917-4617-a14a-9e9db772a9e0 req-9a00ca06-5baa-432c-8bc6-89e84cc77a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b85b34-2833-4601-a003-c3dbbd6a28ae", "name": "network-vif-deleted", "tag": "8767fd17-d40b-4f1a-9b25-b098a6226b0d"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:15.104159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f3a7c36e-f917-4617-a14a-9e9db772a9e0 req-9a00ca06-5baa-432c-8bc6-89e84cc77a60 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:15.104817 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f3a7c36e-f917-4617-a14a-9e9db772a9e0 req-9a00ca06-5baa-432c-8bc6-89e84cc77a60 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.113923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:15.114766 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:15.116154 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-f3a7c36e-f917-4617-a14a-9e9db772a9e0 req-9a00ca06-5baa-432c-8bc6-89e84cc77a60 service nova] Creating event network-vif-deleted:8767fd17-d40b-4f1a-9b25-b098a6226b0d for instance 52b85b34-2833-4601-a003-c3dbbd6a28ae on hv-cinder-83588 May 09 18:35:15.121205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-f3a7c36e-f917-4617-a14a-9e9db772a9e0 req-9a00ca06-5baa-432c-8bc6-89e84cc77a60 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 May 09 18:35:15.121832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:15.121999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 241/463] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:15.122285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.123051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:15.123472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.186992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.194877 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d0c7bc50-25b6-4c30-b3c5-29f265d5c260 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1472 microversion: 2.1 time: 0.084736 May 09 18:35:15.195452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 223/464] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:15 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:16.102053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:16.102758 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:16.109548 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.110006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:16.110778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.111215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:16.221132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:16.222450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:16.230923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.231736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:16.233039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.233559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:16.251065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:16.258907 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4d2b35de-00a5-4a5d-b4a7-8d6e87a92d85 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1682 microversion: 2.1 time: 0.161113 May 09 18:35:16.259476 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 242/465] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:16 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:16.301470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:16.311501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-224f63c4-0ebb-4030-aa8e-321943763ba3 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 200 len: 1303 microversion: 2.1 time: 0.100851 May 09 18:35:16.312234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 224/466] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:16 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:17.276782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:17.277463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:17.283488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:17.283937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.284747 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:17.285172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.330344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:17.330964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 52b85b34-2833-4601-a003-c3dbbd6a28ae] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:17.338513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:17.339495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.341578 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:17.342022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.372351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] HTTP exception thrown: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. May 09 18:35:17.373774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Request method failure captured: May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae HTTP/1.1 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV6k8ptZN_qN31HUzXWxK5x3WsG0y5W1zBh8SGzK9cz4NGd7rwBFFidWa-P9odEePfVsm20zyR35HwdMVsmmkv-cG__QlFYkPk0wajGBIyBc5kCuBWfEyjLwB6BBtZQOVooAZrODWs99-7sjsj_kofmndO4n6t1k411qTsL--zMpsi4 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d435ae0d74c84add84b2ea2293ef8284 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:35:17.374039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d435ae0d74c84add84b2ea2293ef8284"}]}] May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d435ae0d74c84add84b2ea2293ef8284 May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotTestJSON-657428337-project May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: d373d38388d84c0e8b7ffdf992d08461 May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotTestJSON-657428337-project May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. May 09 18:35:17.375656 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '52b85b34-2833-4601-a003-c3dbbd6a28ae'} May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:17.376952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. May 09 18:35:17.378355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:17.379716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Returning 404 to user: Instance 52b85b34-2833-4601-a003-c3dbbd6a28ae could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:17.379716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-165aa62a-8b26-4f0c-bc0d-88f0c358678a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae" status: 404 len: 111 microversion: 2.1 time: 0.049413 May 09 18:35:17.381792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 225/467] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:17 2022] GET /compute/v2.1/servers/52b85b34-2833-4601-a003-c3dbbd6a28ae => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:35:17.390550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b125e93c-3520-4f0a-962d-0440118c832e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1614 microversion: 2.1 time: 0.118002 May 09 18:35:17.396007 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 243/468] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:17 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:17.667880 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-af874264-137c-4bff-af89-8a31a610e1fe req-ce94d873-1a4e-491d-a7a5-79f7a4e5bf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe2046a-655a-4a12-ad29-1427fa1d4f9a", "name": "network-vif-deleted", "tag": "8cb1941d-8c8f-4b27-9f9d-5b70f843c15b"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:17.677328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-af874264-137c-4bff-af89-8a31a610e1fe req-ce94d873-1a4e-491d-a7a5-79f7a4e5bf16 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:17.677766 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-af874264-137c-4bff-af89-8a31a610e1fe req-ce94d873-1a4e-491d-a7a5-79f7a4e5bf16 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.696187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-af874264-137c-4bff-af89-8a31a610e1fe req-ce94d873-1a4e-491d-a7a5-79f7a4e5bf16 service nova] Creating event network-vif-deleted:8cb1941d-8c8f-4b27-9f9d-5b70f843c15b for instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a on hv-cinder-83588 May 09 18:35:17.705965 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-af874264-137c-4bff-af89-8a31a610e1fe req-ce94d873-1a4e-491d-a7a5-79f7a4e5bf16 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042195 May 09 18:35:17.706690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 226/469] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:35:18.411323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:18.412102 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:18.418988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:18.419528 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:18.420412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:18.420911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:18.454602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:18.455050 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:18.455507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'fault' on Instance uuid 8fe2046a-655a-4a12-ad29-1427fa1d4f9a {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:18.496905 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:18.506128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b18a5650-88c9-4de5-bf17-52f7f6b2721f tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1332 microversion: 2.1 time: 0.097651 May 09 18:35:18.506128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 244/470] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:18 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:19.530354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:19.531049 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:19.537849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:19.538305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:19.539082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:19.539529 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:19.571776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:19.572260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:19.572710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'fault' on Instance uuid 8fe2046a-655a-4a12-ad29-1427fa1d4f9a {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:19.615003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:19.622971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-129962d8-0022-4e64-938d-9f8fbb514e29 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1332 microversion: 2.1 time: 0.097568 May 09 18:35:19.623841 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 227/471] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:19 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:20.640161 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:20.640767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:20.646752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:20.647191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:20.647983 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:20.648447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:20.680741 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:20.681194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:20.681646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'fault' on Instance uuid 8fe2046a-655a-4a12-ad29-1427fa1d4f9a {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:20.723105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:20.730093 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-807264a0-215f-4de7-8156-2ba663e4d831 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 200 len: 1332 microversion: 2.1 time: 0.093841 May 09 18:35:20.730671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 245/472] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:20 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:21.747288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:21.747865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:21.754971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:21.755445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:21.756288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:21.756750 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:21.770553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a HTTP/1.1 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:35:21.772278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:35:21.774046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '8fe2046a-655a-4a12-ad29-1427fa1d4f9a'} May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:21.775000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:35:21.776630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:35:21.777940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:21.777940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f10b5542-72cc-4d88-8677-cceddba53ae0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 404 len: 111 microversion: 2.1 time: 0.030617 May 09 18:35:21.777940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 228/473] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:21 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:35:21.782987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1557cd0a-6b9a-4258-bf5a-9dc502b3db2b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '.version_select at 0x7fe8bad8f430>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:21.805192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1557cd0a-6b9a-4258-bf5a-9dc502b3db2b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020117861" status: 202 len: 0 microversion: 2.1 time: 0.026042 May 09 18:35:21.805763 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 246/474] 10.222.0.35 () {58 vars in 1220 bytes} [Mon May 9 18:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020117861 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:35:22.495331 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e8c91b9b-04da-4431-ba98-b1665823a0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: .version_select at 0x7fe8bab9e8b0>, body: {"keypair": {"name": "tempest-keypair-988465379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAgFqATV0ACopAongFt4O1VojkfzAf4wntpLUl8WuLb8ni5S4/OHUCcgUF7D5rVNjdfTIDUdAFHsEjhqMN0MHWztL0n/drjeKBonOkO59/puXzGjbzh20X1UfWVPeUDFQ=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:22.510593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-e8c91b9b-04da-4431-ba98-b1665823a0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:35:22.514902 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-e8c91b9b-04da-4431-ba98-b1665823a0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:35:22.541002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e8c91b9b-04da-4431-ba98-b1665823a0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049817 May 09 18:35:22.541626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 229/475] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:35:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:23.847934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1005256304", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e53078e-3a76-4ed9-ad6f-470a933d3075"}], "security_groups": [{"name": "tempest-securitygroup--1960963079"}], "key_name": "tempest-keypair-988465379", "user_data": "}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:23.956329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] validate_networks() for [('6e53078e-3a76-4ed9-ad6f-470a933d3075', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:35:24.341685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:35:24.342132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:35:24.342595 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:35:24.342992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:35:24.343390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:35:24.352549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.353025 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.353883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.354311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.371379 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:35:24.376254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:35:24.389864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:35:24.392308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:35:24.444080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-07fd5762-b642-4394-b531-ae72805cbc57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.600253 May 09 18:35:24.444645 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 247/476] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:35:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:35:24.458383 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9d0f9d24-eec4-4d16-a399-41ae71f9950b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:24.459398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9d0f9d24-eec4-4d16-a399-41ae71f9950b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:24.504347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5a20f64-73d7-4bad-b490-b4b6ada36fc4"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:24.505801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:24.513087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.513579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.514369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.514767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.516992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9d0f9d24-eec4-4d16-a399-41ae71f9950b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:24.525124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9d0f9d24-eec4-4d16-a399-41ae71f9950b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1241 microversion: 2.1 time: 0.073783 May 09 18:35:24.525864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 230/477] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:24 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:24.939745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-43e30d1a-b7c1-411b-aa33-2662509cb52a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439052 May 09 18:35:24.940394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 248/478] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:35:24 2022] POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:25.183880 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-784026363", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "networks": [{"uuid": "7eb9cf46-1f88-4ffc-b1c8-4992a9de4725"}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:25.236773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] validate_networks() for [('7eb9cf46-1f88-4ffc-b1c8-4992a9de4725', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:35:25.544530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:25.545612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:25.554257 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.554913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.555908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.556559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.877237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:25.887228 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-13382bc1-be1d-43ab-aad9-0198740a7656 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1311 microversion: 2.1 time: 0.347275 May 09 18:35:25.888408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 249/479] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:25 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:25.912437 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:35:25.912936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:35:25.913462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:35:25.913935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:35:25.914409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:35:25.924203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.924659 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.925476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.925914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.942761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Getting quotas for project d435ae0d74c84add84b2ea2293ef8284. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:35:25.947062 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Getting quotas for user d373d38388d84c0e8b7ffdf992d08461 and project d435ae0d74c84add84b2ea2293ef8284. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:35:25.959186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:35:25.961537 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:35:26.018525 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-15ff9973-b1f6-47f8-8a8f-572d7273b4fd tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838619 May 09 18:35:26.026217 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 231/480] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:35:26.031389 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3512bf97-701a-4d75-b639-dd671b913d8b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:26.032670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3512bf97-701a-4d75-b639-dd671b913d8b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:26.112740 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3512bf97-701a-4d75-b639-dd671b913d8b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:26.119594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3512bf97-701a-4d75-b639-dd671b913d8b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1218 microversion: 2.1 time: 0.092824 May 09 18:35:26.120238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 250/481] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:26 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:26.882127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-b4e35a51-ef86-45ea-a41f-e764d8949db9 req-c2a56b4d-7640-4848-99e8-37c38f9a9d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18727e44-19bd-4c22-848c-9a685d8d235e", "tag": "cf194dea-8a01-4c82-a800-236df64b91dc"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:26.893769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b4e35a51-ef86-45ea-a41f-e764d8949db9 req-c2a56b4d-7640-4848-99e8-37c38f9a9d2b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:26.894260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b4e35a51-ef86-45ea-a41f-e764d8949db9 req-c2a56b4d-7640-4848-99e8-37c38f9a9d2b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:26.915079 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-b4e35a51-ef86-45ea-a41f-e764d8949db9 req-c2a56b4d-7640-4848-99e8-37c38f9a9d2b service nova] Creating event network-changed:cf194dea-8a01-4c82-a800-236df64b91dc for instance 18727e44-19bd-4c22-848c-9a685d8d235e on hv-cinder-83588 May 09 18:35:26.920593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-b4e35a51-ef86-45ea-a41f-e764d8949db9 req-c2a56b4d-7640-4848-99e8-37c38f9a9d2b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045547 May 09 18:35:26.921306 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 232/482] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:26.927181 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:26.927815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:26.937159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:26.938024 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:26.938884 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:26.939391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:27.138394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:27.139434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:27.150300 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:27.153203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:27.154320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:27.154759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:27.176692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:27.185359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-78ef413e-d3ec-442b-a6c7-e1ad5cdc8ac8 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.283581 May 09 18:35:27.193702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 251/483] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:26 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:27.305148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:27.312909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-268f050d-276b-4c8d-b186-48a555388a0b tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1288 microversion: 2.1 time: 0.179456 May 09 18:35:27.313798 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 233/484] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:27 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1288 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:28.204036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:28.204615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:28.211398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.211704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.212538 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.212937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.330944 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:28.331602 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:28.338199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.338648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.339419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.339831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.347207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:28.355011 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7a75cc33-d788-4578-bf46-495be24ccbd2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.155112 May 09 18:35:28.355580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 252/485] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:28 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:28.528274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:28.538544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-33e67da4-caad-43ae-bebb-265f62392daa tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.211421 May 09 18:35:28.539870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 234/486] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:28 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:29.088203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-a6b231d1-cc80-4e41-875e-130de9adb182 req-ef9e268f-234e-4557-90c2-12f472b708c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25222dd3-3fb4-40b2-aedc-534909c4e10e", "tag": "7f71ddab-3d6a-4874-a30f-991fff6182fb"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:29.099527 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a6b231d1-cc80-4e41-875e-130de9adb182 req-ef9e268f-234e-4557-90c2-12f472b708c3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.100456 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a6b231d1-cc80-4e41-875e-130de9adb182 req-ef9e268f-234e-4557-90c2-12f472b708c3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.115268 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-a6b231d1-cc80-4e41-875e-130de9adb182 req-ef9e268f-234e-4557-90c2-12f472b708c3 service nova] Creating event network-changed:7f71ddab-3d6a-4874-a30f-991fff6182fb for instance 25222dd3-3fb4-40b2-aedc-534909c4e10e on hv-cinder-83588 May 09 18:35:29.119900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-a6b231d1-cc80-4e41-875e-130de9adb182 req-ef9e268f-234e-4557-90c2-12f472b708c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038450 May 09 18:35:29.121012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 253/487] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:29.372846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:29.373502 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:29.380054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.380543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.381323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.381755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.557886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:29.558535 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:29.565261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.565715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.566543 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.566967 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.593836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:29.603482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d3f1d3a1-c2f2-4dfb-a8b0-50815010f231 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.234538 May 09 18:35:29.604397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 235/488] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:29 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:29.702507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:29.710430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fe74dbe4-d9f2-40e0-a060-7b753b01e684 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.157589 May 09 18:35:29.711011 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 254/489] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:29 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:30.620987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:30.621586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:30.628405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:30.628823 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:30.629595 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:30.630024 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:30.731289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:30.731941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:30.738850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:30.739291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:30.740095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:30.740524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:30.776570 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:30.786303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-df3de901-bf47-4593-a869-bc15bc645861 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.169124 May 09 18:35:30.787004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 236/490] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:30 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:30.874909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:30.883778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-656c123a-5f3c-419e-b499-5e676ab61114 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.156287 May 09 18:35:30.884381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 255/491] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:30 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:31.805273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:31.805885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:31.812556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.813003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.813776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.814204 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.901060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:31.901739 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:31.908360 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.908891 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.909753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.910247 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.963186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:31.970831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-40a4bdce-47f3-4db2-8305-dbb3aa2c0011 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.169587 May 09 18:35:31.971732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 237/492] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:31 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:32.059654 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:32.069569 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ad5db382-06bb-434e-8216-e6e668b9fc48 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.172497 May 09 18:35:32.070213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 256/493] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:31 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:32.548433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:32.549506 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:32.555825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.556312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.557086 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.557521 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.580016 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lazy-loading 'flavor' on Instance uuid 851fc983-3157-401f-953a-acb75d8d1750 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:32.738228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1e8b8711-fe25-4477-9864-6cf0ab8c7d52 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/action" status: 200 len: 32 microversion: 2.1 time: 0.193797 May 09 18:35:32.738900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 238/494] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:35:32 2022] POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:35:32.749153 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:32.749966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:32.756109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.756647 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.757531 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.758031 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.969816 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:32.978190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7cefcd7a-6e2a-4a74-b85c-365ebf935c15 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.233606 May 09 18:35:32.978754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 257/495] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:32 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:32.990743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:32.991452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:32.998335 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.998778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.999547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.999983 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.092854 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:33.093488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:33.099916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:33.100321 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.101103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:33.101523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.277708 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:33.287633 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6728b382-5953-4cd4-94a3-e36bef576753 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.301988 May 09 18:35:33.288913 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 239/496] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:32 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:33.340009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:33.348368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-67c77d6b-fc89-46ac-bb48-bb8ad37e7f6e tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.259383 May 09 18:35:33.348948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 258/497] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:33 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:33.484322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-f3070ffe-48b2-4609-b25c-18987fe183c4 req-b541ffdb-0c95-446b-907e-de9b9ac9e6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18727e44-19bd-4c22-848c-9a685d8d235e", "name": "network-vif-plugged", "status": "completed", "tag": "cf194dea-8a01-4c82-a800-236df64b91dc"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:33.494267 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-f3070ffe-48b2-4609-b25c-18987fe183c4 req-b541ffdb-0c95-446b-907e-de9b9ac9e6c3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:33.494781 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-f3070ffe-48b2-4609-b25c-18987fe183c4 req-b541ffdb-0c95-446b-907e-de9b9ac9e6c3 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.507176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-f3070ffe-48b2-4609-b25c-18987fe183c4 req-b541ffdb-0c95-446b-907e-de9b9ac9e6c3 service nova] Creating event network-vif-plugged:cf194dea-8a01-4c82-a800-236df64b91dc for instance 18727e44-19bd-4c22-848c-9a685d8d235e on hv-cinder-83588 May 09 18:35:33.511991 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-f3070ffe-48b2-4609-b25c-18987fe183c4 req-b541ffdb-0c95-446b-907e-de9b9ac9e6c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 May 09 18:35:33.512831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 240/498] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:33.999549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:34.000486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:34.006889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.007329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.008219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.008655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.183641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.192391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a0bf8026-04dd-4206-adaa-0d2aedd9b9e0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.199715 May 09 18:35:34.192955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 259/499] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:33 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:34.308834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:34.309503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:34.316664 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.317116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.318432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.319097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.365399 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:34.366017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:34.372498 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.372962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.373735 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.374173 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.503580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.512420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2ec4825a-5e5b-419d-abb3-fe31dc88c0fd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.208716 May 09 18:35:34.513133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 241/500] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:34 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:34.536103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.544412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4d4fc078-a953-459d-8c36-1152a9c6a7d8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.182855 May 09 18:35:34.544983 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 260/501] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:34 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:35.210261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:35.210933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:35.217695 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.218190 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.219014 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.219517 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.369588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.377758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-108ba8c1-3fc2-4599-b04d-4800c2e1c8b1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.171861 May 09 18:35:35.378320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 242/502] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:35 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:35.530311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:35.530893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-9ba28ca6-d99a-44f7-8788-93363fe6d0dc req-2065e6b5-a88d-4923-9db7-8dd06430d863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25222dd3-3fb4-40b2-aedc-534909c4e10e", "name": "network-vif-plugged", "status": "completed", "tag": "7f71ddab-3d6a-4874-a30f-991fff6182fb"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:35.531032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:35.537526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.537982 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.538579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9ba28ca6-d99a-44f7-8788-93363fe6d0dc req-2065e6b5-a88d-4923-9db7-8dd06430d863 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.538775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.538995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9ba28ca6-d99a-44f7-8788-93363fe6d0dc req-2065e6b5-a88d-4923-9db7-8dd06430d863 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.539201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.550337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-9ba28ca6-d99a-44f7-8788-93363fe6d0dc req-2065e6b5-a88d-4923-9db7-8dd06430d863 service nova] Creating event network-vif-plugged:7f71ddab-3d6a-4874-a30f-991fff6182fb for instance 25222dd3-3fb4-40b2-aedc-534909c4e10e on hv-cinder-83588 May 09 18:35:35.555346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-9ba28ca6-d99a-44f7-8788-93363fe6d0dc req-2065e6b5-a88d-4923-9db7-8dd06430d863 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028633 May 09 18:35:35.555970 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 243/503] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:35.562217 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:35.562966 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:35.569495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.569922 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.570704 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.571172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.895231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.898853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.903635 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d0c88088-52ab-4de0-b83d-cb3e1eea70e8 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.345701 May 09 18:35:35.904283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 244/504] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:35 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:35.907765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-78b85842-fdd6-4d7d-8dab-0bf2719fb79a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1367 microversion: 2.1 time: 0.381055 May 09 18:35:35.916491 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 261/505] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:35 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:36.396325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:36.396980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:36.404677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.405359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.406300 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.406867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.554528 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:36.563073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a6587d5a-d913-4e09-a40e-602d7916bc69 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.170722 May 09 18:35:36.563673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 245/506] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:36 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:36.921507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:36.922115 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:36.925022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:36.925695 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:36.929287 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.929747 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.930536 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.930997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.932303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.932838 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.933664 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.934177 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.122432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.125646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.131640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f4627799-5d43-4693-a334-6fdd16d35cb6 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1318 microversion: 2.1 time: 0.214440 May 09 18:35:37.132431 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 262/507] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:36 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:37.133490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-795736e7-c849-4142-8402-bdbbbcdec198 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1556 microversion: 2.1 time: 0.212666 May 09 18:35:37.134077 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 246/508] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:36 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:37.156102 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:37.156711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:37.163968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:37.164459 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.165544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:37.166115 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.246021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-00c84e27-f626-411a-adf5-d1f89f5af0b6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096050 May 09 18:35:37.246601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 263/509] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:35:37 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:37.581794 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:37.583087 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:37.589662 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:37.590093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.590970 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:37.591411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.826972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.835579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-aa6daa70-a433-4679-99e8-e0a3728e8dba tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.257634 May 09 18:35:37.836150 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 247/510] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:37 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:38.151404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:38.152400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:38.159490 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.159966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.160747 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.161175 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.392791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:38.400756 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-28e499b1-e4d5-49b4-b710-efe3193c6a84 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1508 microversion: 2.1 time: 0.255050 May 09 18:35:38.401334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 264/511] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:38 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:38.417372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f983c759-9862-4052-9d6d-9a41c9c73e02", "device": "/dev/sdb"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:38.418731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:38.425137 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.425625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.426402 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.426839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.679171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-2313f3d4-7d3d-4858-bcde-d424edddbe9b req-7155348c-c658-4de8-9dd8-5a9ee4ce5da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18727e44-19bd-4c22-848c-9a685d8d235e", "tag": "cf194dea-8a01-4c82-a800-236df64b91dc"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:38.687559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2313f3d4-7d3d-4858-bcde-d424edddbe9b req-7155348c-c658-4de8-9dd8-5a9ee4ce5da5 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.688024 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2313f3d4-7d3d-4858-bcde-d424edddbe9b req-7155348c-c658-4de8-9dd8-5a9ee4ce5da5 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.699684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-2313f3d4-7d3d-4858-bcde-d424edddbe9b req-7155348c-c658-4de8-9dd8-5a9ee4ce5da5 service nova] Creating event network-changed:cf194dea-8a01-4c82-a800-236df64b91dc for instance 18727e44-19bd-4c22-848c-9a685d8d235e on hv-cinder-83588 May 09 18:35:38.703996 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8179cfa2-ede9-49fa-911b-da27d67359f0 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "POST /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290432 May 09 18:35:38.704612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-2313f3d4-7d3d-4858-bcde-d424edddbe9b req-7155348c-c658-4de8-9dd8-5a9ee4ce5da5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029077 May 09 18:35:38.704980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 248/512] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:35:38 2022] POST /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:38.705590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 265/513] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:35:38.857021 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:38.858547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:38.868084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.868709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.869309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.869858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:39.096417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:39.105751 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-23963f58-aeb3-4888-9a63-c561800c3053 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.255158 May 09 18:35:39.106476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 249/514] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:38 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:40.125228 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:40.125953 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:40.132665 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:40.133124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:40.133893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:40.134346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:40.267203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:40.276368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c870c834-3dbf-46a2-84e7-a6134f1c7630 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.156453 May 09 18:35:40.276957 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 266/515] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:40 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:41.294881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:41.295545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:41.302717 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:41.303181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:41.303989 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:41.304519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:41.445745 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:41.453816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a7ae9144-26b6-48c5-b0d6-59092a0ff860 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.163147 May 09 18:35:41.454406 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 250/516] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:41 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:42.470910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:42.471548 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:42.478777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:42.479219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:42.480083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:42.480517 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:42.613017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:42.621365 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-216f0b94-b1a6-4aa2-b66f-e79d65e3df27 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.154469 May 09 18:35:42.622001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 267/517] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:42 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:43.639162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:43.639736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:43.646642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.647095 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:43.647880 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.648665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:43.781058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:43.789565 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-49f79bf4-c7d2-4fd1-b255-1b33d792eb23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.154465 May 09 18:35:43.790388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 251/518] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:43 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:44.807420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:44.807991 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:44.815080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:44.815532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:44.816347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:44.816783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:44.950846 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:44.958990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-edad9aa3-5fe1-4bf8-95cf-60178634a114 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.155652 May 09 18:35:44.959559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 268/519] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:44 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:45.977483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:45.978205 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:45.985431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:45.985899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:45.986684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:45.987121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:46.127738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:46.140694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42531f52-5ede-45d1-9ead-e7dbde999d41 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.166972 May 09 18:35:46.141621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 252/520] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:45 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:47.166652 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:47.167286 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:47.175382 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:47.175839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:47.176655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:47.177115 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:47.309995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:47.318159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1ab9e97e-3fc6-459d-8a11-41aad7603820 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.155412 May 09 18:35:47.318768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 269/521] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:47 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:48.336748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:48.337613 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:48.344332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.344791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.345566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.345995 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.479256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:48.487749 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8fa0c419-69c8-4cf2-8118-71d443f8cb99 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.155135 May 09 18:35:48.488373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 253/522] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:48 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:49.506084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:49.506666 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:49.515854 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:49.516777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:49.519857 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:49.520344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:49.659940 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:49.667973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ce4c9658-bb8c-4b05-ad0c-70dfdf78efce tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.166068 May 09 18:35:49.668729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 270/523] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:49 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:50.689534 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:50.690515 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:50.700405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:50.701013 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:50.702227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:50.702887 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:50.839990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:50.848235 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-edacfa6c-532d-438d-8a84-c33e57675ea9 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.165621 May 09 18:35:50.848817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 254/524] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:50 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:51.866294 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:51.866870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:51.873708 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:51.874160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:51.874935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:51.875352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:52.014100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:52.022318 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4cf759cb-f76c-4533-b4d7-c335ca9761dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.160086 May 09 18:35:52.023264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 271/525] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:51 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:53.041210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:53.041783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:53.048642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:53.049092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:53.049858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:53.050288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:53.186634 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:53.194805 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-49597a94-b375-43af-97b8-800801038ad3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.157515 May 09 18:35:53.195356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 255/526] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:53 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:54.212921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:54.213542 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:54.220478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:54.220929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:54.221697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:54.222127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:54.364028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:54.373010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-408b2b69-3f14-41da-8011-38477d5abdde tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.163922 May 09 18:35:54.373616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 272/527] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:54 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:55.392371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:55.393018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:55.400444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:55.400888 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:55.401652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:55.402137 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:55.566992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:55.577253 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c2ff031a-6e50-4773-ad27-cb1fc32c2b0c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.189538 May 09 18:35:55.577850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 256/528] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:55 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:56.595544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:56.596208 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:56.603132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:56.603587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:56.604507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:56.604940 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:56.751986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:56.761362 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-783d6c1a-9721-4084-8b31-4336dc12c587 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.170163 May 09 18:35:56.761930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 273/529] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:56 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:57.779975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:57.780499 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:57.787802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.788428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.789618 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.790313 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.932419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:57.940714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d0bbabd4-0dbe-44a3-a0b6-e8c578a8723b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1737 microversion: 2.1 time: 0.164802 May 09 18:35:57.941324 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 257/530] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:57 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:58.087918 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:58.088515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:58.095392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.095861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:58.096678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.097120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:58.186341 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lazy-loading 'services' on Instance uuid 25222dd3-3fb4-40b2-aedc-534909c4e10e {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:58.279404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-71110e2b-ed0c-4a6f-a064-f3dd47159e36 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "DELETE /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e/os-volume_attachments/f983c759-9862-4052-9d6d-9a41c9c73e02" status: 202 len: 0 microversion: 2.1 time: 0.194864 May 09 18:35:58.280532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 274/531] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:35:58 2022] DELETE /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e/os-volume_attachments/f983c759-9862-4052-9d6d-9a41c9c73e02 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:35:58.958957 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:58.959609 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:58.966792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.967291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:58.968129 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.968579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.132967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.141638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-005fe4b8-7fed-4c2a-a5ce-c14e9d4514a0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1717 microversion: 2.1 time: 0.186655 May 09 18:35:59.142479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 258/532] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:58 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:59.278961 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.279556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.286420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.286874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.287664 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.288121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.400121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] HTTP exception thrown: Cannot 'detach_volume' instance 851fc983-3157-401f-953a-acb75d8d1750 while it is in vm_state rescued May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Request method failure captured: May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments/a5a20f64-73d7-4bad-b490-b4b6ada36fc4 HTTP/1.1 May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4LBU3oVmpQ7Qzk4dnuc5jbFUFVFj9XAGi5_-1sRTA43vOXwrRrtzNspTaml6xfFYfsdudnJ297zxZ-yDeexT1MrlSujVOflHCehf_CZoFDW5rqgse6TX55xZsAgN6Q7JgFhcbLdDZlNKFGaLkFrPMIqtYBs6WtqZNEml8cm3bvQYA May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:35:59.401990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de55d649ff94599ae5dd076719b438f"}]}] May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: eea376d0ec0b45958d63f7a94312d689 May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:35:59.403422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Cannot 'detach_volume' instance 851fc983-3157-401f-953a-acb75d8d1750 while it is in vm_state rescued May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': '851fc983-3157-401f-953a-acb75d8d1750', 'id': 'a5a20f64-73d7-4bad-b490-b4b6ada36fc4'} May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 851fc983-3157-401f-953a-acb75d8d1750 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:59.404304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 851fc983-3157-401f-953a-acb75d8d1750 while it is in vm_state rescued May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 851fc983-3157-401f-953a-acb75d8d1750 while it is in vm_state rescued May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:35:59.405717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Returning 409 to user: Cannot 'detach_volume' instance 851fc983-3157-401f-953a-acb75d8d1750 while it is in vm_state rescued {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:59.407855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-96c0ef3c-2d73-4796-abcc-b0887fa227dd tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments/a5a20f64-73d7-4bad-b490-b4b6ada36fc4" status: 409 len: 152 microversion: 2.1 time: 0.129783 May 09 18:35:59.407855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 275/533] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:35:59 2022] DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments/a5a20f64-73d7-4bad-b490-b4b6ada36fc4 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 18:35:59.408187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.408187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.412851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:59.413396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.414050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.414521 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.415307 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.415729 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.421396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.421396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.421396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.422023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.441422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:35:59.494055 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7dcecc30-c43a-4e0a-85c4-2866e2c26d21 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/action" status: 202 len: 0 microversion: 2.1 time: 0.084939 May 09 18:35:59.494872 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 276/534] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:35:59 2022] POST /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:35:59.503978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.504809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.512320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.512847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.513688 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.514379 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.531236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e51b1306-7231-4853-acbb-d87f741796fc tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "DELETE /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 204 len: 0 microversion: 2.1 time: 0.127560 May 09 18:35:59.531928 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 259/535] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:35:59 2022] DELETE /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:35:59.541065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.544300 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.549850 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.550372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.551255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.551767 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.719850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.728083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b8bb9d0b-95bf-442a-add8-551df8c097d0 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1725 microversion: 2.1 time: 0.228530 May 09 18:35:59.728670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 277/536] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:59 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:59.732870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.740734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-75bcf8b3-6e08-48e5-97ec-9b2f60ccb13a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1514 microversion: 2.1 time: 0.204013 May 09 18:35:59.741358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 260/537] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:35:59 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:00.746220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:00.746800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:00.753515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.753965 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.754743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.755179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.758996 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:00.759624 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:00.766379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.766831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.767622 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.768111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.951458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.954227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.959902 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-64a2599f-9450-493a-9dc6-197dd2039b4a tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1514 microversion: 2.1 time: 0.205659 May 09 18:36:00.961476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 261/538] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:00 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:00.963250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-81f20afa-a41b-4c66-9038-c1429e152b79 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1725 microversion: 2.1 time: 0.221040 May 09 18:36:00.963904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 278/539] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:00 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:01.978434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:01.983846 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:01.984813 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:01.985312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:01.995559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.996065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.996902 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.997309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.005406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.006127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.006932 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.007626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.263674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.268851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.276768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8744bd93-ae89-47d7-80c4-f42057ecc4eb tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1725 microversion: 2.1 time: 0.296452 May 09 18:36:02.277124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1ae48cf5-6fd7-4290-b661-2d91a3f2bd4d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1514 microversion: 2.1 time: 0.302669 May 09 18:36:02.286941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 279/540] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:01 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:02.287498 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 262/541] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:01 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:02.293634 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-1a133a6e-4692-4eb4-b952-09395241527a req-e181bdf7-7a95-4a6b-a79a-2da654b60a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25222dd3-3fb4-40b2-aedc-534909c4e10e", "name": "network-vif-deleted", "tag": "7f71ddab-3d6a-4874-a30f-991fff6182fb"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:02.302415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-1a133a6e-4692-4eb4-b952-09395241527a req-e181bdf7-7a95-4a6b-a79a-2da654b60a36 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.302869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-1a133a6e-4692-4eb4-b952-09395241527a req-e181bdf7-7a95-4a6b-a79a-2da654b60a36 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.317780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-1a133a6e-4692-4eb4-b952-09395241527a req-e181bdf7-7a95-4a6b-a79a-2da654b60a36 service nova] Creating event network-vif-deleted:7f71ddab-3d6a-4874-a30f-991fff6182fb for instance 25222dd3-3fb4-40b2-aedc-534909c4e10e on hv-cinder-83588 May 09 18:36:02.322741 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-1a133a6e-4692-4eb4-b952-09395241527a req-e181bdf7-7a95-4a6b-a79a-2da654b60a36 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033012 May 09 18:36:02.323325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 280/542] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:03.299445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.300387 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.301097 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.301687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.311411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.311571 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.311867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.312034 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.312689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.312802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.313125 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.313229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.344767 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.345207 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.345667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lazy-loading 'fault' on Instance uuid 25222dd3-3fb4-40b2-aedc-534909c4e10e {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:03.403238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.410539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c5a57133-98b4-4b4a-9474-37e461244768 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1308 microversion: 2.1 time: 0.118741 May 09 18:36:03.411109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 263/543] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:03.465879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.473999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d212f94f-c2a4-4bec-b378-8c07cd4dda56 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1725 microversion: 2.1 time: 0.181876 May 09 18:36:03.474565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 281/544] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:04.153364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2017815047"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:04.153926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.160645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.161089 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.161855 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.162280 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.306591 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.network.security_group_api [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Removing security group dc1b843f-741c-40be-9252-90df23430358 from port 019a5ad8-184e-45fd-809a-48b4e4a491c4 May 09 18:36:04.429242 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.429968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.437225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.437676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.438464 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.438896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.471041 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.471497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.471989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lazy-loading 'fault' on Instance uuid 25222dd3-3fb4-40b2-aedc-534909c4e10e {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:04.753249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373d38388d84c0e8b7ffdf992d08461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd435ae0d74c84add84b2ea2293ef8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.762314 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-89d35ebf-a823-4d9c-82c2-c538278da83d tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 200 len: 1308 microversion: 2.1 time: 0.337745 May 09 18:36:04.763038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 282/545] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:04.768216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.768831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.776453 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.777185 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.778100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.778632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.980851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.988897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fc62b2f6-735c-49a7-9b05-c1ec6fe30581 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1731 microversion: 2.1 time: 0.224489 May 09 18:36:04.989464 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 283/546] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:05.006656 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:05.007054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:05.013590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.014037 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.014829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.015235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.047390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-565b201d-e3a7-4e6f-9f8b-3188052d1cf0 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action" status: 202 len: 0 microversion: 2.1 time: 0.900481 May 09 18:36:05.048254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 264/547] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:36:04 2022] POST /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/action => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:05.067349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-b36cb8c0-d833-44ae-b1a2-1ab4bf1a71ff req-12dff828-a75a-4065-ad69-e0433167b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:05.078372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b36cb8c0-d833-44ae-b1a2-1ab4bf1a71ff req-12dff828-a75a-4065-ad69-e0433167b1ab service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.079060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-b36cb8c0-d833-44ae-b1a2-1ab4bf1a71ff req-12dff828-a75a-4065-ad69-e0433167b1ab service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.101925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-b36cb8c0-d833-44ae-b1a2-1ab4bf1a71ff req-12dff828-a75a-4065-ad69-e0433167b1ab service nova] Creating event network-changed:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:36:05.111734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-b36cb8c0-d833-44ae-b1a2-1ab4bf1a71ff req-12dff828-a75a-4065-ad69-e0433167b1ab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049136 May 09 18:36:05.113022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 265/548] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:05.147875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-03922f58-be1e-4355-95a7-e6577a81ddc4 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144823 May 09 18:36:05.148520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 284/549] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:36:05 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:05.785061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:05.785788 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] [instance: 25222dd3-3fb4-40b2-aedc-534909c4e10e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:05.793104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.793557 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.794397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.794836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] HTTP exception thrown: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Request method failure captured: May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e HTTP/1.1 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV6k8ptZN_qN31HUzXWxK5x3WsG0y5W1zBh8SGzK9cz4NGd7rwBFFidWa-P9odEePfVsm20zyR35HwdMVsmmkv-cG__QlFYkPk0wajGBIyBc5kCuBWfEyjLwB6BBtZQOVooAZrODWs99-7sjsj_kofmndO4n6t1k411qTsL--zMpsi4 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: d435ae0d74c84add84b2ea2293ef8284 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:36:05.814215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d435ae0d74c84add84b2ea2293ef8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d435ae0d74c84add84b2ea2293ef8284"}]}] May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: d435ae0d74c84add84b2ea2293ef8284 May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-657428337 May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-VolumesSnapshotTestJSON-657428337-project May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: d373d38388d84c0e8b7ffdf992d08461 May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-VolumesSnapshotTestJSON-657428337-project May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. May 09 18:36:05.815682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '25222dd3-3fb4-40b2-aedc-534909c4e10e'} May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:05.816459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. May 09 18:36:05.817722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:05.818853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] Returning 404 to user: Instance 25222dd3-3fb4-40b2-aedc-534909c4e10e could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:05.818853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-77a1e106-43e9-4a13-ae50-32a2eac70df9 tempest-VolumesSnapshotTestJSON-657428337 tempest-VolumesSnapshotTestJSON-657428337-project] 10.222.0.35 "GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e" status: 404 len: 111 microversion: 2.1 time: 0.032423 May 09 18:36:05.818853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 266/550] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:05 2022] GET /compute/v2.1/servers/25222dd3-3fb4-40b2-aedc-534909c4e10e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:07.094487 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:07.094993 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:07.107185 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.107604 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.108960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.108960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.127735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}, {"name": "network-changed", "server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}, {"name": "network-changed", "server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:07.139414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.140132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.155581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Creating event network-changed:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:36:07.156373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Creating event network-changed:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:36:07.157022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] Creating event network-changed:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:36:07.165583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-603301e5-2ac3-487c-b157-720d031d0bf0 req-57779435-1158-492d-84b6-750238663126 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.041320 May 09 18:36:07.167305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 267/551] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:07.231675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lazy-loading 'services' on Instance uuid 89307799-7b5f-4c33-89d4-e8b76fe645af {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:07.354519 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-86d02897-db06-479a-9662-f3d1f9ef929b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments/0095ef47-82cd-4b84-b48e-9188b2fae528" status: 202 len: 0 microversion: 2.1 time: 0.264157 May 09 18:36:07.355610 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 285/552] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:36:07 2022] DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments/0095ef47-82cd-4b84-b48e-9188b2fae528 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:07.367044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:07.368119 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:07.382022 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.382611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.386078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.386732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.443081 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6fb4e523-bc59-42ec-9ac6-56afb2f72991 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083080 May 09 18:36:07.444189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 268/553] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:07 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:08.458907 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:08.460339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:08.467508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.467829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.468638 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.469067 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.507082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ce3cc248-e664-4291-9a4a-cee694ad8078 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054688 May 09 18:36:08.507886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 286/554] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:08 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:09.519614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:09.520668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:09.529581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:09.530063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:09.530836 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:09.531265 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:09.560580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c026f2b6-1508-4373-ae26-4291d0efee0b tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 May 09 18:36:09.561141 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 269/555] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:09 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:10.572432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:10.573581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:10.580052 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.580484 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.581470 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.581920 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.612292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-42fb4482-ff30-4e49-9203-230496fc8e10 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 May 09 18:36:10.613097 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 287/556] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:10 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:11.624374 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.625320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.635783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.636483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.637672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.638323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.671639 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-eb142627-0032-4d47-841c-c48cbd3195d6 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051301 May 09 18:36:11.672509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 270/557] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:11 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:36:11.682987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.683575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.690026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.690453 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.691375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.691650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.770633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] HTTP exception thrown: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af is not attached to volume 0095ef47-82cd-4b84-b48e-9188b2fae528 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Request method failure captured: May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments/0095ef47-82cd-4b84-b48e-9188b2fae528 HTTP/1.1 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV5jSC8Fras11sQ8bB2FsbZxJNMhb9WQH3kAAwnBuNe8Yj5z3vtGyjawwu77qIBpjYp4B05w70p3BjVFeRwZKlSYosvqP36YHFCj1gDbtz_bSrlbvCYCKRY0T4uEh9C4tqopDA6eOa-DwnQSobgll8A69sg0IcZexxaUV02NGtwMa54 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 4bcfbd7c368b4090868727d9dadf0ad2 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:36:11.782133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4bcfbd7c368b4090868727d9dadf0ad2"}]}] May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 4bcfbd7c368b4090868727d9dadf0ad2 May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-TestMinimumBasicScenario-1596987763-project May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: cb748c2f041944a2b81b46f9e8eae2ca May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-TestMinimumBasicScenario-1596987763-project May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:36:11.783909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af is not attached to volume 0095ef47-82cd-4b84-b48e-9188b2fae528 May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': '89307799-7b5f-4c33-89d4-e8b76fe645af', 'id': '0095ef47-82cd-4b84-b48e-9188b2fae528'} May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0095ef47-82cd-4b84-b48e-9188b2fae528. May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:11.785015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af is not attached to volume 0095ef47-82cd-4b84-b48e-9188b2fae528 May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af is not attached to volume 0095ef47-82cd-4b84-b48e-9188b2fae528 May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:11.786244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Returning 404 to user: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af is not attached to volume 0095ef47-82cd-4b84-b48e-9188b2fae528 {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:11.787245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-24fe825c-a10c-47a4-8ec7-75e4f5723023 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments/0095ef47-82cd-4b84-b48e-9188b2fae528" status: 404 len: 154 microversion: 2.1 time: 0.105190 May 09 18:36:11.787245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 288/558] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:36:11 2022] DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af/os-volume_attachments/0095ef47-82cd-4b84-b48e-9188b2fae528 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:12.956720 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:12.957545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:12.965471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.965959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.966738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.967173 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.995716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:13.078813 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ba246e63-5747-43d8-9cce-24eb3868b26f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 204 len: 0 microversion: 2.1 time: 0.126846 May 09 18:36:13.079509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 271/559] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:36:12 2022] DELETE /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:13.088302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:13.089004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:13.095864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.096364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.097203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.097667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.241922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:13.252946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b5cb37db-fa5e-4039-a8ce-18b58b31219f tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1555 microversion: 2.1 time: 0.168476 May 09 18:36:13.253565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 289/560] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:13 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:14.278673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:14.279846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:14.290949 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:14.291707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:14.292761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:14.293199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:14.430315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:14.437849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1800747e-0114-420c-a4f5-db13e781b429 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1555 microversion: 2.1 time: 0.166765 May 09 18:36:14.438417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 272/561] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:14 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:15.458817 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:15.459900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:15.468359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:15.468811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:15.469575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:15.470004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:15.610562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:15.618153 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-721874b3-8e0c-4ef9-b48e-b7797de4ee6e tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1555 microversion: 2.1 time: 0.165693 May 09 18:36:15.618603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 290/562] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:15 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:16.634584 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:16.635197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:16.641627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:16.642104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:16.642859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:16.643290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:16.781170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:16.789249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-91b32bad-e798-4266-91a8-99bdb999a8f9 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1555 microversion: 2.1 time: 0.158439 May 09 18:36:16.789865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 273/563] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:16 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:17.808603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:17.809219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:17.815676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:17.816172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:17.816998 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:17.817440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:17.950348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb748c2f041944a2b81b46f9e8eae2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcfbd7c368b4090868727d9dadf0ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:17.957975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-16f9dc87-a777-41a6-b5f9-52154ef86d94 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 200 len: 1555 microversion: 2.1 time: 0.154788 May 09 18:36:17.958589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 291/564] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:17 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:18.121238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-2a0a9bc0-837e-4e28-9b07-acce67e6e4ab req-def34fec-a130-46cf-835e-f3ec4f07e1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89307799-7b5f-4c33-89d4-e8b76fe645af", "name": "network-vif-deleted", "tag": "019a5ad8-184e-45fd-809a-48b4e4a491c4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:18.132760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-2a0a9bc0-837e-4e28-9b07-acce67e6e4ab req-def34fec-a130-46cf-835e-f3ec4f07e1f2 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:18.133396 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-2a0a9bc0-837e-4e28-9b07-acce67e6e4ab req-def34fec-a130-46cf-835e-f3ec4f07e1f2 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:18.154007 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-2a0a9bc0-837e-4e28-9b07-acce67e6e4ab req-def34fec-a130-46cf-835e-f3ec4f07e1f2 service nova] Creating event network-vif-deleted:019a5ad8-184e-45fd-809a-48b4e4a491c4 for instance 89307799-7b5f-4c33-89d4-e8b76fe645af on hv-cinder-83588 May 09 18:36:18.161712 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-2a0a9bc0-837e-4e28-9b07-acce67e6e4ab req-def34fec-a130-46cf-835e-f3ec4f07e1f2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 May 09 18:36:18.162703 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 274/565] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:18.977966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:18.979629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] [instance: 89307799-7b5f-4c33-89d4-e8b76fe645af] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:18.987526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:18.988045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:18.988913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:18.989394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:19.017103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] HTTP exception thrown: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Request method failure captured: May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af HTTP/1.1 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV5jSC8Fras11sQ8bB2FsbZxJNMhb9WQH3kAAwnBuNe8Yj5z3vtGyjawwu77qIBpjYp4B05w70p3BjVFeRwZKlSYosvqP36YHFCj1gDbtz_bSrlbvCYCKRY0T4uEh9C4tqopDA6eOa-DwnQSobgll8A69sg0IcZexxaUV02NGtwMa54 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 4bcfbd7c368b4090868727d9dadf0ad2 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:36:19.020101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4bcfbd7c368b4090868727d9dadf0ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4bcfbd7c368b4090868727d9dadf0ad2"}]}] May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 4bcfbd7c368b4090868727d9dadf0ad2 May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1596987763 May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-TestMinimumBasicScenario-1596987763-project May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: cb748c2f041944a2b81b46f9e8eae2ca May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-TestMinimumBasicScenario-1596987763-project May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. May 09 18:36:19.021658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '89307799-7b5f-4c33-89d4-e8b76fe645af'} May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:19.023040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. May 09 18:36:19.024259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:19.026568 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Returning 404 to user: Instance 89307799-7b5f-4c33-89d4-e8b76fe645af could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:19.027908 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3baceb39-2b34-49ac-8ca9-7d44a8fb451d tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af" status: 404 len: 111 microversion: 2.1 time: 0.055811 May 09 18:36:19.029126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 292/566] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:18 2022] GET /compute/v2.1/servers/89307799-7b5f-4c33-89d4-e8b76fe645af => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:19.038417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-08632a78-83ca-49ec-8107-1bd2b7034465 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] Calling method '.version_select at 0x7fe8bab0b8b0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:19.065936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-08632a78-83ca-49ec-8107-1bd2b7034465 tempest-TestMinimumBasicScenario-1596987763 tempest-TestMinimumBasicScenario-1596987763-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1214391683" status: 202 len: 0 microversion: 2.1 time: 0.031738 May 09 18:36:19.066883 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 275/567] 10.222.0.35 () {58 vars in 1271 bytes} [Mon May 9 18:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1214391683 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:34.044327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:34.044825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:34.051874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.052662 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.053649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.054056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.081981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2da54ca6-7efd-400f-a76b-fb32ea34b281 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/ips" status: 200 len: 148 microversion: 2.1 time: 0.043639 May 09 18:36:34.082856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 293/568] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:36:34 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:35.505096 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f056c0-58d9-4761-8123-31b4080091df"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:35.509341 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:35.518961 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.519408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:35.520226 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.520654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:36.541809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4197435a-b06a-4b95-abbe-bb8cb0369c57 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043429 May 09 18:36:36.559444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 276/569] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:36:35 2022] POST /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 194 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:39.042972 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-91d41cfe-fe12-4f16-bdbe-2166cf2dd13a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Action: 'create', calling method: .version_select at 0x7fe8bac01820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2006085322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGPTSg/sL1EDgVkdJn0SGr3YH6/eCK/JifRJsY4iNkq/wl+bzzQo8V0Kqm+ngF6PtFZY6XMDjRF0u2axecpDJGIvU/Px2gR8PKyKXqUjjlGjdO9excbrtAmkNQHKogw+Q=="}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:39.062032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-91d41cfe-fe12-4f16-bdbe-2166cf2dd13a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for project 9292fda06d234de8b60b0131b87bbf46. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:36:39.066118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-91d41cfe-fe12-4f16-bdbe-2166cf2dd13a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for user 86609452d1a44c9d953ed642936003f1 and project 9292fda06d234de8b60b0131b87bbf46. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:36:39.089566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-91d41cfe-fe12-4f16-bdbe-2166cf2dd13a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.156900 May 09 18:36:39.090429 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 294/570] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:36:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:39.333959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.334610 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:39.342023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.342471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.343583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.344699 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.490144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lazy-loading 'services' on Instance uuid 851fc983-3157-401f-953a-acb75d8d1750 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:39.733739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b1cadaaf-0a7b-4dc7-adb2-4b9a7afb3632 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments/a5a20f64-73d7-4bad-b490-b4b6ada36fc4" status: 202 len: 0 microversion: 2.1 time: 0.405072 May 09 18:36:39.734707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 277/571] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:36:39 2022] DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments/a5a20f64-73d7-4bad-b490-b4b6ada36fc4 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:36:39.744363 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.745933 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:39.756845 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.757620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.758429 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.758870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.837675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-21c92200-daf3-4112-ba8d-599ae47f7667 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096245 May 09 18:36:39.840687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 295/572] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:39 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:40.852274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:40.853476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:40.866641 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:40.867264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:40.868446 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:40.869086 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:40.909560 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-813cf288-bc06-4642-86f8-7de4cd9bab1f tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062286 May 09 18:36:40.913484 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 278/573] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:40 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:41.921554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:41.922627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:41.930073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:41.930675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:41.931734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:41.932179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:41.970680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b66f015b-af14-4925-b279-35c3c6fb6d05 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053020 May 09 18:36:41.972193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 296/574] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:41 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:42.987999 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:42.988958 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:42.996462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:42.996462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:42.997107 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:42.997542 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.031732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-726a32bc-6f3e-4743-9334-069645ed7288 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 May 09 18:36:43.032414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 279/575] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:42 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:43.197792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f056c0-58d9-4761-8123-31b4080091df"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:43.199128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:43.207581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.208451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.209594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.210265 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.370293 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: POST /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments HTTP/1.1 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 74 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:36:43.371930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {"volumeAttachment": {"volumeId": "29f056c0-58d9-4761-8123-31b4080091df"}} May 09 18:36:43.373786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'server_id': '18727e44-19bd-4c22-848c-9a685d8d235e', 'body': {'volumeAttachment': {'volumeId': '29f056c0-58d9-4761-8123-31b4080091df'}}} May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:43.375138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:43.377545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 400 to user: Invalid volume: volume 29f056c0-58d9-4761-8123-31b4080091df is already attached to instances: 18727e44-19bd-4c22-848c-9a685d8d235e {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f184013e-0a15-4383-adc7-f98e29e0dfee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.180279 May 09 18:36:43.379986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 297/576] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:36:43 2022] POST /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 174 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:36:43.445212 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:43.445905 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:43.452933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.453305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.454115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.454539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.541168 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'services' on Instance uuid 18727e44-19bd-4c22-848c-9a685d8d235e {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:43.621858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cf36a7c3-98e0-4efa-b1bc-848d132bb7b0 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments/29f056c0-58d9-4761-8123-31b4080091df" status: 202 len: 0 microversion: 2.1 time: 0.180674 May 09 18:36:43.622617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 280/577] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:36:43 2022] DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments/29f056c0-58d9-4761-8123-31b4080091df => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:43.631775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:43.633677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:43.642628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.643095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.643915 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:43.644393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:43.696080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a7351e90-3e94-4a00-a56b-10c16d634e23 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068327 May 09 18:36:43.696722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 298/578] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:43 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:44.044473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:44.046881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:44.058298 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.059002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.060318 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.060872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.091884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e9b2b043-4bf3-4cd7-9dde-c5904e15406b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052628 May 09 18:36:44.092490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 281/579] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:44 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:36:44.177895 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:44.178696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:44.185535 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.186107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.186883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.187545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.215252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:44.312913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-560c4d9d-23e2-4790-87e4-29c20a0a73bc tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 204 len: 0 microversion: 2.1 time: 0.141934 May 09 18:36:44.317203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 299/580] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:36:44 2022] DELETE /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:36:44.323900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:44.324692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:44.332256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.332702 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.333673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.334100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.477825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:44.490290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f667658a-6738-488c-a3e0-d480a44fa8b2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1691 microversion: 2.1 time: 0.170339 May 09 18:36:44.490548 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 282/581] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:44 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:44.708847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:44.709999 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:44.716901 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.717353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.718135 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:44.718552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:44.750553 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a2ce8f38-d403-4620-a954-88d7ea4b589e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 May 09 18:36:44.750962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 300/582] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:44 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:45.506911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:45.507681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:45.514543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:45.514990 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:45.515797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:45.516274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:45.661361 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:45.670426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0afeca09-3c54-4c4f-8234-89c586aeaaf2 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1691 microversion: 2.1 time: 0.167385 May 09 18:36:45.671030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 283/583] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:45 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:45.762649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:45.763623 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:45.770640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:45.771425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:45.772248 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:45.772706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:45.804956 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-dd39be6d-aaf9-408a-b796-8abbb42c3974 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046485 May 09 18:36:45.805548 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 301/584] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:45 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:46.688778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:46.689601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:46.697747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:46.698187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:46.698981 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:46.699411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:46.816626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:46.817889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:46.827682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:46.827682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:46.827682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:46.827682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:46.855458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:46.864291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9b31b727-14a0-4f29-b37e-f74844458e3c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1691 microversion: 2.1 time: 0.179887 May 09 18:36:46.868070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 284/585] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:46 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:46.869048 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9c278379-bd8b-4ada-96d2-b5c7d8140392 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056023 May 09 18:36:46.869989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 302/586] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:46 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:47.882291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:47.882914 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:47.883786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:47.885575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:47.891094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:47.891877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:47.892691 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:47.892866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:47.893105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:47.893240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:47.894188 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:47.894796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:47.938456 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-76150064-d243-4baa-868b-f87c068ace3d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060390 May 09 18:36:47.939930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 303/587] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:36:47 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:36:48.021896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:48.022698 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:48.031460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:48.032353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:48.033376 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:48.033994 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:48.065759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:48.071807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:48.079932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a5923710-ad7e-4418-934a-32df87cf430a tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1691 microversion: 2.1 time: 0.201893 May 09 18:36:48.080552 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 285/588] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:47 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:48.160944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2c40b24a-2909-49d9-9b5a-e00d4f099307 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 204 len: 0 microversion: 2.1 time: 0.146351 May 09 18:36:48.161940 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 304/589] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:36:48 2022] DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:48.170627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:48.171652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:48.178502 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:48.179325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:48.180194 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:48.180594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:48.324926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:48.334585 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d02857f0-16a9-4f08-8819-a3d53269b426 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1680 microversion: 2.1 time: 0.166278 May 09 18:36:48.334585 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 286/590] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:48 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:48.944065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-56af53cf-0f04-43a7-8985-79f8fd12bc31 req-28a57caf-60e6-4380-9d86-36f795d0b6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851fc983-3157-401f-953a-acb75d8d1750", "name": "network-vif-deleted", "tag": "14dd9dc4-e111-4f90-b4fe-2e68f7712463"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:48.954068 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-56af53cf-0f04-43a7-8985-79f8fd12bc31 req-28a57caf-60e6-4380-9d86-36f795d0b6f4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:48.954507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-56af53cf-0f04-43a7-8985-79f8fd12bc31 req-28a57caf-60e6-4380-9d86-36f795d0b6f4 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:48.967469 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-56af53cf-0f04-43a7-8985-79f8fd12bc31 req-28a57caf-60e6-4380-9d86-36f795d0b6f4 service nova] Creating event network-vif-deleted:14dd9dc4-e111-4f90-b4fe-2e68f7712463 for instance 851fc983-3157-401f-953a-acb75d8d1750 on hv-cinder-83588 May 09 18:36:48.976794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-56af53cf-0f04-43a7-8985-79f8fd12bc31 req-28a57caf-60e6-4380-9d86-36f795d0b6f4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117535 May 09 18:36:48.980805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 305/591] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:49.098167 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:49.099942 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:49.107284 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:49.107832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:49.108728 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:49.109263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:49.176276 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:49.185086 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3dc84972-1068-4f72-85f9-da9a9c8c1a07 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1623 microversion: 2.1 time: 0.090935 May 09 18:36:49.185675 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 287/592] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:49 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:49.353253 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:49.353953 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:49.360963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:49.361410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:49.365565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:49.365565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:49.520665 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:49.529835 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-59fbafab-1cd6-4f82-8bea-4214ff75aebd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1680 microversion: 2.1 time: 0.180916 May 09 18:36:49.530532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 306/593] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:49 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:50.204573 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:50.205200 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:50.221714 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:50.222598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:50.223671 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:50.224927 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:50.274210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:50.274664 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:50.275483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lazy-loading 'fault' on Instance uuid 851fc983-3157-401f-953a-acb75d8d1750 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:50.336959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:50.344679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3557ac0f-2f6e-40c6-83d6-ff1934465805 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 200 len: 1335 microversion: 2.1 time: 0.145125 May 09 18:36:50.345303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 288/594] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:50 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:50.547921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:50.548659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:50.557687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:50.558201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:50.559010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:50.559439 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:50.716552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:50.725755 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5be17f03-18b2-436e-8d82-a9a202f40d3e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 200 len: 1680 microversion: 2.1 time: 0.181728 May 09 18:36:50.726714 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 307/595] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:50 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:51.169612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-3a164e34-8697-4643-ac2c-5ba1bad31a33 req-da1c9457-c68e-48b3-867a-04bb0bc71cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18727e44-19bd-4c22-848c-9a685d8d235e", "name": "network-vif-deleted", "tag": "cf194dea-8a01-4c82-a800-236df64b91dc"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:51.178421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-3a164e34-8697-4643-ac2c-5ba1bad31a33 req-da1c9457-c68e-48b3-867a-04bb0bc71cdd service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:51.179028 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-3a164e34-8697-4643-ac2c-5ba1bad31a33 req-da1c9457-c68e-48b3-867a-04bb0bc71cdd service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:51.190749 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-3a164e34-8697-4643-ac2c-5ba1bad31a33 req-da1c9457-c68e-48b3-867a-04bb0bc71cdd service nova] Creating event network-vif-deleted:cf194dea-8a01-4c82-a800-236df64b91dc for instance 18727e44-19bd-4c22-848c-9a685d8d235e on hv-cinder-83588 May 09 18:36:51.196901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-3a164e34-8697-4643-ac2c-5ba1bad31a33 req-da1c9457-c68e-48b3-867a-04bb0bc71cdd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 May 09 18:36:51.197517 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 289/596] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:51.362298 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:51.362917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 851fc983-3157-401f-953a-acb75d8d1750] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:51.369268 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:51.369961 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:51.371012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:51.371449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:51.386369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] HTTP exception thrown: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Request method failure captured: May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 HTTP/1.1 May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4LBU3oVmpQ7Qzk4dnuc5jbFUFVFj9XAGi5_-1sRTA43vOXwrRrtzNspTaml6xfFYfsdudnJ297zxZ-yDeexT1MrlSujVOflHCehf_CZoFDW5rqgse6TX55xZsAgN6Q7JgFhcbLdDZlNKFGaLkFrPMIqtYBs6WtqZNEml8cm3bvQYA May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:36:51.388111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de55d649ff94599ae5dd076719b438f"}]}] May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: eea376d0ec0b45958d63f7a94312d689 May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. May 09 18:36:51.389733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '851fc983-3157-401f-953a-acb75d8d1750'} May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:51.390631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. May 09 18:36:51.392205 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.395712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Returning 404 to user: Instance 851fc983-3157-401f-953a-acb75d8d1750 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:51.397536 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b84224c2-fbf3-4e9c-bbfa-3572ddd63e23 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750" status: 404 len: 111 microversion: 2.1 time: 0.039137 May 09 18:36:51.398295 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 308/597] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:51 2022] GET /compute/v2.1/servers/851fc983-3157-401f-953a-acb75d8d1750 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:51.407373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-594b9e7b-d17b-4e3b-9116-39c6cdc01488 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '.version_select at 0x7fe8bab9e280>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:51.426647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-594b9e7b-d17b-4e3b-9116-39c6cdc01488 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292839750" status: 202 len: 0 microversion: 2.1 time: 0.023850 May 09 18:36:51.427320 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 290/598] 10.222.0.35 () {58 vars in 1217 bytes} [Mon May 9 18:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292839750 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:51.744749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:51.745412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:51.751890 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:51.752359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:51.753122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:51.754058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:51.779800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e HTTP/1.1 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:36:51.781381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:36:51.783003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '18727e44-19bd-4c22-848c-9a685d8d235e'} May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:51.783873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:36:51.785432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:36:51.787317 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:51.787317 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-57757315-8a82-4536-a8be-da648c031031 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 404 len: 111 microversion: 2.1 time: 0.042297 May 09 18:36:51.787317 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 309/599] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:51 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:51.793771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5b7369b5-ad03-4dd6-99ca-ebec3d247c80 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '.version_select at 0x7fe8bab83700>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:51.817661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5b7369b5-ad03-4dd6-99ca-ebec3d247c80 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988465379" status: 202 len: 0 microversion: 2.1 time: 0.028067 May 09 18:36:51.818873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 291/600] 10.222.0.35 () {58 vars in 1217 bytes} [Mon May 9 18:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988465379 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:52.614210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-738c1028-a54e-42e3-8ce7-1328ccee0650 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: .version_select at 0x7fe8bac01af0>, body: {"keypair": {"name": "tempest-keypair-1815781724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGS6178rGFMgvUsTJEAAtj0+mPBxEli3vHtMpmhVF2yPgiSLDd0NkQLn5M3BzY0PMlMqaj+mHUPnK4Ee+QDu9VMqc0mTGbEwUpy300rx5N+wSR9sQW6XVPFj5CNdMlVKw=="}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:52.628509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-738c1028-a54e-42e3-8ce7-1328ccee0650 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:36:52.632658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-738c1028-a54e-42e3-8ce7-1328ccee0650 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:36:52.656609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-738c1028-a54e-42e3-8ce7-1328ccee0650 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046517 May 09 18:36:52.657220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 310/601] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:36:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:54.222428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-186451902", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e53078e-3a76-4ed9-ad6f-470a933d3075"}], "security_groups": [{"name": "tempest-securitygroup--2141131830"}], "key_name": "tempest-keypair-1815781724", "user_data": "}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:54.334832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] validate_networks() for [('6e53078e-3a76-4ed9-ad6f-470a933d3075', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:36:54.463668 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:54.464311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:54.471227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.471752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.472638 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.473275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.503061 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:54.579342 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-02db4fd8-68a1-4dc5-87fb-75a3ae7e0e1c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 204 len: 0 microversion: 2.1 time: 0.119661 May 09 18:36:54.579990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 311/602] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:36:54 2022] DELETE /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:54.589674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:54.590381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:54.596396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.596850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.597618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.598049 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.795878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:54.803890 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f4e80a73-42f0-4b49-91d8-ab601234cde3 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1509 microversion: 2.1 time: 0.219608 May 09 18:36:54.804486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 312/603] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:54 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:54.878508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:36:54.879111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:36:54.879768 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:36:54.880379 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:36:54.881025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:36:54.892451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.892894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.893728 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.894165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.911426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:36:54.915807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Getting quotas for user 3b88e2a92518436fb863dc0a41b0f4f7 and project 79098f9314ff48a7b9a10c4f29df9245. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:36:54.927563 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:36:54.930003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:36:54.979564 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8cda8a2f-7935-41d3-bada-98df15862fdd tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.761994 May 09 18:36:54.980540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 292/604] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:36:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:36:54.990551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-beb7b46b-2899-49d5-84ff-8ff5a9653eee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:54.991445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-beb7b46b-2899-49d5-84ff-8ff5a9653eee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:55.049805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-beb7b46b-2899-49d5-84ff-8ff5a9653eee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:55.057187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-beb7b46b-2899-49d5-84ff-8ff5a9653eee tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1241 microversion: 2.1 time: 0.070714 May 09 18:36:55.057782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 313/605] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:54 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:55.597166 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-947306222", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006085322", "security_groups": [{"name": "tempest-secgroup-smoke-1009084773"}], "block_device_mapping_v2": [{"uuid": "635a551c-6a9b-41a2-82de-c8665a49b630", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9626c38-13d9-423a-9810-cc67a8569feb"}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:55.711521 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] validate_networks() for [('b9626c38-13d9-423a-9810-cc67a8569feb', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:36:55.821295 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:55.821889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:55.829662 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.830103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:55.830879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.831309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.038126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.046089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8d5d8e2e-a016-4bdc-9db0-fef86608a732 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1509 microversion: 2.1 time: 0.228669 May 09 18:36:56.046641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 314/606] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:55 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:56.073902 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:56.074516 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:56.081292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.081760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.082602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.083035 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.155814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.163415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a827abe4-1377-4b0f-ac3e-cb89e9d74b46 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1245 microversion: 2.1 time: 0.093313 May 09 18:36:56.163989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 315/607] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:56 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:56.181917 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:36:56.182347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:36:56.182820 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:36:56.183227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:36:56.183666 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:36:56.193784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.194235 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.195038 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.195474 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.213193 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:36:56.218405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for user 86609452d1a44c9d953ed642936003f1 and project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:36:56.287841 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:36:56.289932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='635a551c-6a9b-41a2-82de-c8665a49b630',volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:36:56.418968 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fefea61f-98aa-4336-8185-8731a172808f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.826602 May 09 18:36:56.419611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 293/608] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:36:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:36:56.429885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b73bc8f2-a484-441a-8eff-93ef3ffd5197 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:56.430641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b73bc8f2-a484-441a-8eff-93ef3ffd5197 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:56.487590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b73bc8f2-a484-441a-8eff-93ef3ffd5197 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.494165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b73bc8f2-a484-441a-8eff-93ef3ffd5197 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1094 microversion: 2.1 time: 0.068049 May 09 18:36:56.495265 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 316/609] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:56 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:57.063862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:57.064471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:57.071364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.071906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.072810 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.073509 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.180884 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:57.181792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:57.191682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.192334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.195555 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.196112 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.310836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:57.336745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-dbe95c24-5dc3-4bc8-84a2-e3910f07c859 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1301 microversion: 2.1 time: 0.159859 May 09 18:36:57.337366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 317/610] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:57 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:57.360229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:57.369197 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1a73da83-0d49-4f37-9355-e71e8cff65e6 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 200 len: 1509 microversion: 2.1 time: 0.309968 May 09 18:36:57.370148 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 294/611] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:57 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:57.419977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-377eda15-2b43-4b87-85b1-3b9708061bcf req-b1daff51-e555-470a-8f2c-5beb2adb394c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636e0866-b43c-484b-9c6e-4a9bbf99bc64", "name": "network-vif-deleted", "tag": "3fab78a6-4e33-406a-b544-8fdb086015c3"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:57.428004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-377eda15-2b43-4b87-85b1-3b9708061bcf req-b1daff51-e555-470a-8f2c-5beb2adb394c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.428473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-377eda15-2b43-4b87-85b1-3b9708061bcf req-b1daff51-e555-470a-8f2c-5beb2adb394c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.440744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-377eda15-2b43-4b87-85b1-3b9708061bcf req-b1daff51-e555-470a-8f2c-5beb2adb394c service nova] Creating event network-vif-deleted:3fab78a6-4e33-406a-b544-8fdb086015c3 for instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 on hv-cinder-83588 May 09 18:36:57.445888 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-377eda15-2b43-4b87-85b1-3b9708061bcf req-b1daff51-e555-470a-8f2c-5beb2adb394c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 May 09 18:36:57.446511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 318/612] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:57.516071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:57.516960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:57.524784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.525206 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.526173 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.526769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.617032 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:57.627439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3f494f4f-1b8d-4398-ae26-ca9de1cad284 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1192 microversion: 2.1 time: 0.115432 May 09 18:36:57.628052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 295/613] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:57 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:58.355101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.355740 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.362886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.363387 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.364149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.364583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.394519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.396879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: 636e0866-b43c-484b-9c6e-4a9bbf99bc64] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.407814 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.409068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.413451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.416641 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.443121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] HTTP exception thrown: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Request method failure captured: May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 HTTP/1.1 May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4LBU3oVmpQ7Qzk4dnuc5jbFUFVFj9XAGi5_-1sRTA43vOXwrRrtzNspTaml6xfFYfsdudnJ297zxZ-yDeexT1MrlSujVOflHCehf_CZoFDW5rqgse6TX55xZsAgN6Q7JgFhcbLdDZlNKFGaLkFrPMIqtYBs6WtqZNEml8cm3bvQYA May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:36:58.445408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de55d649ff94599ae5dd076719b438f"}]}] May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: eea376d0ec0b45958d63f7a94312d689 May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. May 09 18:36:58.446878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '636e0866-b43c-484b-9c6e-4a9bbf99bc64'} May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:58.447976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. May 09 18:36:58.449541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:36:58.451926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Returning 404 to user: Instance 636e0866-b43c-484b-9c6e-4a9bbf99bc64 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:58.453305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5cce82b5-7f29-4753-b95b-e19d85e977ee tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64" status: 404 len: 111 microversion: 2.1 time: 0.064871 May 09 18:36:58.457976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 296/614] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:58 2022] GET /compute/v2.1/servers/636e0866-b43c-484b-9c6e-4a9bbf99bc64 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:58.471798 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.472696 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.486939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.487391 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.492606 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.493394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.535135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:58.660674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-97739ec6-2c96-4e6f-9afb-bfd2d92c568c tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 204 len: 0 microversion: 2.1 time: 0.200704 May 09 18:36:58.662004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 297/615] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:36:58 2022] DELETE /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:58.667637 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.668508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.673127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:58.674744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.675730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.677083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.677786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.683587 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6845b7e5-f47b-4a52-b714-1ac5dab178fb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.333281 May 09 18:36:58.688150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 319/616] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:58 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:58.700820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.701592 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.711864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.716497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.717558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.724702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.037313 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.045984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6438b115-5f76-4be2-8a10-053086fb092e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.382649 May 09 18:36:59.046581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 298/617] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:58 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:59.061416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.069033 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-eb8336be-8fa8-4870-b839-97e8e0ff6fd1 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.379798 May 09 18:36:59.069580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 320/618] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:58 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:59.413625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-ac204be0-e870-446b-a985-5858fe38200b req-06d1d95d-5727-42a1-a6f7-16e49fd5f058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a61b79-b16a-4d24-bb89-97a54ff7cfeb", "tag": "3d1d91de-a26e-4130-90aa-df7b0a558865"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:59.422612 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-ac204be0-e870-446b-a985-5858fe38200b req-06d1d95d-5727-42a1-a6f7-16e49fd5f058 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:59.423565 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-ac204be0-e870-446b-a985-5858fe38200b req-06d1d95d-5727-42a1-a6f7-16e49fd5f058 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.438483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-ac204be0-e870-446b-a985-5858fe38200b req-06d1d95d-5727-42a1-a6f7-16e49fd5f058 service nova] Creating event network-changed:3d1d91de-a26e-4130-90aa-df7b0a558865 for instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb on hv-cinder-83588 May 09 18:36:59.443603 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-ac204be0-e870-446b-a985-5858fe38200b req-06d1d95d-5727-42a1-a6f7-16e49fd5f058 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033680 May 09 18:36:59.444423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 299/619] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:59.704365 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:59.705143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:59.713028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:59.713499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.714404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:59.714830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.851261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.859978 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f10631c6-e749-490a-9ba8-28c59dc467c9 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.160120 May 09 18:36:59.860560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 321/620] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:36:59 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:00.063595 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:00.064258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:00.071131 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.071574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.072396 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.072823 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.088392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:00.089189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:00.096385 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.096844 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.097722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.098405 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.271376 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.281980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b7599564-f664-412e-9205-0f259f2aeb65 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.222708 May 09 18:37:00.282777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 300/621] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:00 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:00.283291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.291127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4b345f56-7ff4-4d62-ac04-20bf6a1569d5 tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.207626 May 09 18:37:00.291777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 322/622] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:00 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:00.877418 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:00.878068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:00.884968 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.885438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.887075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.887525 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.022737 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:01.030789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-24c8c8c0-a492-4fe3-adb5-53ff4efd38d1 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.157585 May 09 18:37:01.031411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 301/623] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:00 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:01.299118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:01.299661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:01.306670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.307099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.307875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.308358 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.309236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:01.309963 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:01.324260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.324260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.324260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.324260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.561556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:01.564091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:01.570894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-412adb25-30e8-4a33-9261-de174a8b0a10 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.275841 May 09 18:37:01.572711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-aec3dd3b-1223-4296-8fc6-312fcf748ced tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1521 microversion: 2.1 time: 0.267424 May 09 18:37:01.573448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 302/624] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:01 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:01.583688 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 323/625] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:01 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:02.049683 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:02.051040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:02.062067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.062538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.063355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.063792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.319825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.329392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9589e853-b647-4414-8f67-deb14a928c56 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.283324 May 09 18:37:02.330256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 303/626] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:02 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:02.389195 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-6afb6e73-076b-48b9-bfac-cd750040a540 req-2dbbe7e3-18aa-4af9-8e28-c7712b6fb5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297d06a6-18b9-45b0-9bbe-91cbb3667fa7", "tag": "7c668d56-62b3-465e-b8b4-741373748f28"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:02.398563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6afb6e73-076b-48b9-bfac-cd750040a540 req-2dbbe7e3-18aa-4af9-8e28-c7712b6fb5f1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.398869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-6afb6e73-076b-48b9-bfac-cd750040a540 req-2dbbe7e3-18aa-4af9-8e28-c7712b6fb5f1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.412892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-6afb6e73-076b-48b9-bfac-cd750040a540 req-2dbbe7e3-18aa-4af9-8e28-c7712b6fb5f1 service nova] Creating event network-changed:7c668d56-62b3-465e-b8b4-741373748f28 for instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 on hv-cinder-83588 May 09 18:37:02.422605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-6afb6e73-076b-48b9-bfac-cd750040a540 req-2dbbe7e3-18aa-4af9-8e28-c7712b6fb5f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037664 May 09 18:37:02.423202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 324/627] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:02.590255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:02.591218 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:02.592198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:02.593168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:02.598121 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.598561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.599427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.599558 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.600053 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.600696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.601667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.602100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.689114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea376d0ec0b45958d63f7a94312d689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de55d649ff94599ae5dd076719b438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.696940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-619fa910-f742-469d-947d-9442f8b9cabf tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 200 len: 1479 microversion: 2.1 time: 0.110845 May 09 18:37:02.697546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 304/628] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:02 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 1479 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:02.759808 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.768321 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c6f90a03-e72e-4791-97d9-e82f70a2b8db tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.181045 May 09 18:37:02.768936 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 325/629] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:02 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:03.346872 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:03.347479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:03.356322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.356778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.357570 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.358011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.509867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:03.518095 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e30aa03c-8534-4d48-82a2-00fa07d375d3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.175114 May 09 18:37:03.518685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 305/630] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:03 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:03.717209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:03.717783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] [instance: f4246c50-6390-4bc7-80e5-1af76bf497d8] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:03.725344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.726060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.727154 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.727907 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.750814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] HTTP exception thrown: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Request method failure captured: May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 HTTP/1.1 May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4LBU3oVmpQ7Qzk4dnuc5jbFUFVFj9XAGi5_-1sRTA43vOXwrRrtzNspTaml6xfFYfsdudnJ297zxZ-yDeexT1MrlSujVOflHCehf_CZoFDW5rqgse6TX55xZsAgN6Q7JgFhcbLdDZlNKFGaLkFrPMIqtYBs6WtqZNEml8cm3bvQYA May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:37:03.753942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de55d649ff94599ae5dd076719b438f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de55d649ff94599ae5dd076719b438f"}]}] May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7de55d649ff94599ae5dd076719b438f May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752107692 May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: eea376d0ec0b45958d63f7a94312d689 May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752107692-project May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. May 09 18:37:03.755269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'f4246c50-6390-4bc7-80e5-1af76bf497d8'} May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:03.756038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. May 09 18:37:03.757194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:37:03.758758 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] Returning 404 to user: Instance f4246c50-6390-4bc7-80e5-1af76bf497d8 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:03.758758 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a784ac18-73e5-4883-874e-c2d6e0cd219b tempest-ServerRescueNegativeTestJSON-752107692 tempest-ServerRescueNegativeTestJSON-752107692-project] 10.222.0.35 "GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8" status: 404 len: 111 microversion: 2.1 time: 0.043065 May 09 18:37:03.758758 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 326/631] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:03 2022] GET /compute/v2.1/servers/f4246c50-6390-4bc7-80e5-1af76bf497d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:37:03.790209 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:03.790841 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:03.797526 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.797975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.798755 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.799191 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.944563 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:03.953324 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-68d4b27b-ea1d-478b-8ee0-31b83785dae5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.168877 May 09 18:37:03.953819 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 306/632] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:03 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:04.458145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-b664a5b8-888f-4007-8a0e-b781b91a1841 req-8f139624-d9ac-4334-ad88-e52489e18d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4246c50-6390-4bc7-80e5-1af76bf497d8", "name": "network-vif-deleted", "tag": "24ee4c5b-8470-4eee-a206-18696d387c6d"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:04.467094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-b664a5b8-888f-4007-8a0e-b781b91a1841 req-8f139624-d9ac-4334-ad88-e52489e18d2d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:04.467611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-b664a5b8-888f-4007-8a0e-b781b91a1841 req-8f139624-d9ac-4334-ad88-e52489e18d2d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:04.480507 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-b664a5b8-888f-4007-8a0e-b781b91a1841 req-8f139624-d9ac-4334-ad88-e52489e18d2d service nova] Creating event network-vif-deleted:24ee4c5b-8470-4eee-a206-18696d387c6d for instance f4246c50-6390-4bc7-80e5-1af76bf497d8 on hv-cinder-83588 May 09 18:37:04.485750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-b664a5b8-888f-4007-8a0e-b781b91a1841 req-8f139624-d9ac-4334-ad88-e52489e18d2d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 May 09 18:37:04.486492 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 327/633] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:04.535326 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:04.536323 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:04.543660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:04.544220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:04.545444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:04.546162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:04.686818 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:04.696632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ffdb06df-e93c-45dd-95cd-78dcddc86526 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.165584 May 09 18:37:04.697283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 307/634] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:04 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:04.972727 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:04.973475 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:04.980627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:04.981118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:04.981981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:04.982449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:05.119760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:05.127304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6558e160-0339-431f-8d31-b3f97f248999 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.159839 May 09 18:37:05.127866 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 328/635] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:04 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:05.714587 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:05.715215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:05.722249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:05.722697 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:05.723901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:05.724322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:05.877894 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:05.885744 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-562d1541-ea65-434c-a6cb-555c7e2e99e6 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.175335 May 09 18:37:05.886278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 308/636] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:05 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:06.146126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:06.146721 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:06.154576 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.155083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.155879 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.156356 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.504602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:06.512445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2bd6847f-8489-4cd1-abb0-3bc2a6fb9a76 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.370939 May 09 18:37:06.512993 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 329/637] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:06 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:06.902866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:06.903456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:06.909986 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.910439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.911238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.911670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.171042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:07.179309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e99c8225-f487-4fc2-a90f-1a0f284e91c7 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.280387 May 09 18:37:07.180023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 309/638] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:06 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:07.530003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:07.530728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:07.545028 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.546227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.548000 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.555425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.791335 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:07.816120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-52eed879-b6bf-4316-b93a-a88440d44022 req-f3328b30-c33c-476e-9bac-9f12ea97eea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a61b79-b16a-4d24-bb89-97a54ff7cfeb", "name": "network-vif-plugged", "status": "completed", "tag": "3d1d91de-a26e-4130-90aa-df7b0a558865"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:07.824520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d7531a94-eac9-451d-8881-7b14e381d3e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.280473 May 09 18:37:07.826316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 330/639] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:07 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:07.839356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-52eed879-b6bf-4316-b93a-a88440d44022 req-f3328b30-c33c-476e-9bac-9f12ea97eea8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.840180 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-52eed879-b6bf-4316-b93a-a88440d44022 req-f3328b30-c33c-476e-9bac-9f12ea97eea8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.853747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-52eed879-b6bf-4316-b93a-a88440d44022 req-f3328b30-c33c-476e-9bac-9f12ea97eea8 service nova] Creating event network-vif-plugged:3d1d91de-a26e-4130-90aa-df7b0a558865 for instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb on hv-cinder-83588 May 09 18:37:07.859082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-52eed879-b6bf-4316-b93a-a88440d44022 req-f3328b30-c33c-476e-9bac-9f12ea97eea8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051156 May 09 18:37:07.860293 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 310/640] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:08.197241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:08.197855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:08.203794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:08.204274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:08.205040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:08.205465 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:08.341568 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:08.349403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7feac57a-5c1e-420d-a1f6-9f49181f8615 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.156233 May 09 18:37:08.349994 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 331/641] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:08 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:08.844006 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:08.844725 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:08.851354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:08.851817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:08.852616 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:08.853045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:08.986758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:08.994519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-65631b2d-1a4a-45a0-964d-9232ee67be5d tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.154648 May 09 18:37:08.995092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 311/642] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:08 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:09.366516 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:09.367150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:09.374299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:09.374800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:09.375600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:09.376094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:09.596674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:09.609366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b8855970-015c-40f6-b851-600de572a039 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1367 microversion: 2.1 time: 0.246453 May 09 18:37:09.612052 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 332/643] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:09 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:10.013155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:10.013834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:10.021740 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.022465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.023250 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.023856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.299578 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:10.307792 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-92695c10-52cb-4c1e-9282-ae02dec9c472 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.299768 May 09 18:37:10.308495 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 312/644] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:10 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:10.629144 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:10.630607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:10.637889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.638343 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.639216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.639663 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.849320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:10.857760 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d51df339-19de-4259-a6b3-98d3b92d0cc2 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1557 microversion: 2.1 time: 0.232589 May 09 18:37:10.858357 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 333/645] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:10 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:10.874219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:10.874793 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:10.884398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.885144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.886208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.886635 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:11.011076 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c929d331-ddb5-4361-99d2-e3f35e51432b tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140608 May 09 18:37:11.011627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 313/646] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:37:10 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:11.325408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:11.326292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:11.332890 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:11.333340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:11.334134 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:11.334559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:11.541761 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:11.579143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5164643e-9184-486a-9dfc-e6c87983ac7c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.245281 May 09 18:37:11.579143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 334/647] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:11 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:12.604571 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:12.605997 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:12.620385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:12.621084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:12.624201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:12.625116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:12.755850 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-cc20c9e4-1e55-482e-a375-7a029315edca req-c90aab43-03f0-40f6-9045-16e7835163a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a61b79-b16a-4d24-bb89-97a54ff7cfeb", "tag": "3d1d91de-a26e-4130-90aa-df7b0a558865"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:12.765336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-cc20c9e4-1e55-482e-a375-7a029315edca req-c90aab43-03f0-40f6-9045-16e7835163a0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:12.766044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-cc20c9e4-1e55-482e-a375-7a029315edca req-c90aab43-03f0-40f6-9045-16e7835163a0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:12.784627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-cc20c9e4-1e55-482e-a375-7a029315edca req-c90aab43-03f0-40f6-9045-16e7835163a0 service nova] Creating event network-changed:3d1d91de-a26e-4130-90aa-df7b0a558865 for instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb on hv-cinder-83588 May 09 18:37:12.792513 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-cc20c9e4-1e55-482e-a375-7a029315edca req-c90aab43-03f0-40f6-9045-16e7835163a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040482 May 09 18:37:12.793559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 335/648] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:12.935181 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:12.943161 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-57cabe7a-ac94-431e-9053-47340369eb96 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.348913 May 09 18:37:12.948274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 314/649] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:12 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:13.974121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:13.975645 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:13.986785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:13.989412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:13.992704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:13.993369 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:14.297491 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:14.312220 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-23ac9d35-b798-4a15-b079-d77a07db0365 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.342631 May 09 18:37:14.313394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 336/650] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:13 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:14.976514 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-399f7fc0-72d1-45d5-929e-810b77b5b66d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: .version_select at 0x7fe8baab9c10>, body: {"keypair": {"name": "tempest-keypair-1808167085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxF7KZcBzS/SoLC0o/TBkvCeKDTDi+AcHc9g/p1wj++0NZ5br5wkgQSvLlvjAlHSriYyA7xnpBgp/xVx9yX1NLl9gShUcFp4pCwugAgRchSYb//z+9IS8N9Khs4Z4XuVw=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:14.991004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-399f7fc0-72d1-45d5-929e-810b77b5b66d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for project 149f6b903b8f4fb688927a1234efa295. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:14.994752 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-399f7fc0-72d1-45d5-929e-810b77b5b66d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for user 890667c36f9646b1a9fcc907f28b4b1b and project 149f6b903b8f4fb688927a1234efa295. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:15.022429 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-399f7fc0-72d1-45d5-929e-810b77b5b66d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.179312 May 09 18:37:15.023021 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 315/651] 10.222.0.35 () {62 vars in 1199 bytes} [Mon May 9 18:37:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 18:37:15.331626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:15.332361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:15.344965 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:15.345800 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:15.346578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:15.347251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:15.519224 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:15.527662 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1c5fb5f1-10fa-42fe-9cd1-45806652a6c1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.200300 May 09 18:37:15.528929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 337/652] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:15 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:16.115487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-15e51fbb-02f8-4737-b35e-3ef1c04e3ca1 req-59493637-7305-4e07-964d-24818a637e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297d06a6-18b9-45b0-9bbe-91cbb3667fa7", "name": "network-vif-plugged", "status": "completed", "tag": "7c668d56-62b3-465e-b8b4-741373748f28"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:16.127228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-15e51fbb-02f8-4737-b35e-3ef1c04e3ca1 req-59493637-7305-4e07-964d-24818a637e7b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.127668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-15e51fbb-02f8-4737-b35e-3ef1c04e3ca1 req-59493637-7305-4e07-964d-24818a637e7b service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.140490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-15e51fbb-02f8-4737-b35e-3ef1c04e3ca1 req-59493637-7305-4e07-964d-24818a637e7b service nova] Creating event network-vif-plugged:7c668d56-62b3-465e-b8b4-741373748f28 for instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 on hv-cinder-83588 May 09 18:37:16.146429 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-15e51fbb-02f8-4737-b35e-3ef1c04e3ca1 req-59493637-7305-4e07-964d-24818a637e7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109040 May 09 18:37:16.147239 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 316/653] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:16.533063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1275284247", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5852b8c9-f3ae-4859-9362-6cdfd85a956c"}], "security_groups": [{"name": "tempest-securitygroup--735560444"}], "key_name": "tempest-keypair-1808167085", "user_data": "}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:16.549444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:16.550165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:16.558480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.559111 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.560245 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.560735 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.710665 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] validate_networks() for [('5852b8c9-f3ae-4859-9362-6cdfd85a956c', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:37:16.800637 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:16.813045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cee7eb43-8dc3-486c-8c07-d2d7dd960376 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.266790 May 09 18:37:16.823503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 317/654] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:16 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:17.234422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:37:17.234839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:37:17.235315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:37:17.235912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:37:17.236351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:37:17.247346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:17.247789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:17.248679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:17.249180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:17.267506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for project 149f6b903b8f4fb688927a1234efa295. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:17.272818 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for user 890667c36f9646b1a9fcc907f28b4b1b and project 149f6b903b8f4fb688927a1234efa295. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:17.285633 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:37:17.287963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:37:17.339467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-68fdf768-95e4-495c-b0a0-e061174dce90 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.812494 May 09 18:37:17.339467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 338/655] 10.222.0.35 () {62 vars in 1187 bytes} [Mon May 9 18:37:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 18:37:17.357614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:17.358236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:17.420993 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:17.431551 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:17.436446 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:17.439029 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-806bd09f-6b70-41f6-9e43-a8b82048777b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1282 microversion: 2.20 time: 0.094338 May 09 18:37:17.440134 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 318/656] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:17 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:17.831685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:17.832359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:17.860236 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:17.861182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:17.862248 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:17.862959 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.056172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.071616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c8c9796b-90a0-423d-b321-f9556d4d18e0 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1266 microversion: 2.1 time: 0.243769 May 09 18:37:18.072815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 339/657] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:17 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:18.458672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:18.459451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:18.468577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.469229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.470112 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.470847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.549964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.569052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.570707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.571900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-74b51b0a-2d0f-49aa-8ed6-4d118483ed3f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1334 microversion: 2.20 time: 0.117326 May 09 18:37:18.572840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 319/658] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:18 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:19.090399 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:19.091149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:19.101877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.102479 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.103292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.103732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.242273 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.250149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-238befc2-b588-4943-8be1-b1c32d870fba tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1454 microversion: 2.1 time: 0.163702 May 09 18:37:19.250744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 340/659] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:19 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:19.272758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:19.273383 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:19.279562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.280040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.280840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.281287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.454259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.464221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-41e9bf5b-c02b-498c-9216-e7f0c6bc69ed tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1454 microversion: 2.1 time: 0.195376 May 09 18:37:19.465201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 320/660] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:19 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1454 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:19.591730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:19.592653 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:19.600995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.604299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.605268 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.606676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.887875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.899015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.901137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.905499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4fe7dc7d-aa5b-41bc-8291-b6442d09b903 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.317787 May 09 18:37:19.906354 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 341/661] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:19 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:20.315760 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-481ba4a9-0ce8-48ef-8b19-cb88c84ed627 req-eefcd4da-758a-4c29-b87b-33aa7cfc72be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:20.326629 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-481ba4a9-0ce8-48ef-8b19-cb88c84ed627 req-eefcd4da-758a-4c29-b87b-33aa7cfc72be service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.327350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-481ba4a9-0ce8-48ef-8b19-cb88c84ed627 req-eefcd4da-758a-4c29-b87b-33aa7cfc72be service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.350468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-481ba4a9-0ce8-48ef-8b19-cb88c84ed627 req-eefcd4da-758a-4c29-b87b-33aa7cfc72be service nova] Creating event network-changed:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:37:20.365763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-481ba4a9-0ce8-48ef-8b19-cb88c84ed627 req-eefcd4da-758a-4c29-b87b-33aa7cfc72be service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054480 May 09 18:37:20.366665 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 321/662] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:20.925149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:20.925827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:20.933451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.933931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.934734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.935147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:21.171309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:21.180101 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:21.181603 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:21.182759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8e8c5a4d-3421-458e-b60e-9b68089823ed tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.262100 May 09 18:37:21.183305 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 342/663] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:20 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:21.949999 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-9aff62ba-8fbe-47a0-b7c1-7153acf024b6 req-dafb5127-cd2c-4b78-aa5c-bf95c49650b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297d06a6-18b9-45b0-9bbe-91cbb3667fa7", "tag": "7c668d56-62b3-465e-b8b4-741373748f28"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:21.958875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9aff62ba-8fbe-47a0-b7c1-7153acf024b6 req-dafb5127-cd2c-4b78-aa5c-bf95c49650b8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:21.959211 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-9aff62ba-8fbe-47a0-b7c1-7153acf024b6 req-dafb5127-cd2c-4b78-aa5c-bf95c49650b8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:21.971135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-9aff62ba-8fbe-47a0-b7c1-7153acf024b6 req-dafb5127-cd2c-4b78-aa5c-bf95c49650b8 service nova] Creating event network-changed:7c668d56-62b3-465e-b8b4-741373748f28 for instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 on hv-cinder-83588 May 09 18:37:21.976372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-9aff62ba-8fbe-47a0-b7c1-7153acf024b6 req-dafb5127-cd2c-4b78-aa5c-bf95c49650b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096947 May 09 18:37:21.976978 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 322/664] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:22.201703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:22.202957 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:22.211653 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.212074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.212839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.213466 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.366891 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:22.384226 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:22.386039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:22.387381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e3bde30a-2a2c-4a79-b9ad-373e144f3ad6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.190062 May 09 18:37:22.388175 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 343/665] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:22 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:23.407489 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:23.408347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:23.415133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:23.415586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:23.416408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:23.416928 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:23.545573 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:23.553613 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:23.555035 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:23.556196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d486cd72-88e3-4845-bca9-4c0fa2c76524 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.153567 May 09 18:37:23.556769 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 323/666] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:23 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:24.576043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:24.576629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:24.583573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.583984 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.584752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.585186 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.720333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:24.729080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:24.730728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:24.731838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e96c76b3-70ba-4818-b169-c82d8b096327 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.160295 May 09 18:37:24.732509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 344/667] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:24 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:25.750535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:25.751145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:25.758158 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.758592 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.759378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.759893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.766807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-2eb4612f-fece-49dc-8443-786c2331fea6 req-3d9eb9f8-24b2-4914-956c-8196072f338c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "name": "network-vif-plugged", "status": "completed", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:25.781781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2eb4612f-fece-49dc-8443-786c2331fea6 req-3d9eb9f8-24b2-4914-956c-8196072f338c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.781977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2eb4612f-fece-49dc-8443-786c2331fea6 req-3d9eb9f8-24b2-4914-956c-8196072f338c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.794413 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-2eb4612f-fece-49dc-8443-786c2331fea6 req-3d9eb9f8-24b2-4914-956c-8196072f338c service nova] Creating event network-vif-plugged:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:37:25.800495 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-2eb4612f-fece-49dc-8443-786c2331fea6 req-3d9eb9f8-24b2-4914-956c-8196072f338c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038892 May 09 18:37:25.801344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 345/668] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:25.910225 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:25.920032 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:25.921532 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:25.922645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ff2993fd-1cb2-403c-89b8-2362e00ab0ff tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.176223 May 09 18:37:25.923199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 324/669] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:25 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:26.942404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:26.943177 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:26.951897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.952289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:26.953082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.953516 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:27.101993 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:27.110574 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:27.112116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:27.113267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-caf88f46-1593-4e89-84be-e63c60aab422 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1407 microversion: 2.20 time: 0.175876 May 09 18:37:27.113880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 346/670] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:26 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:28.132322 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:28.132945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:28.139725 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.140214 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.141025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.141460 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.278000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:28.286454 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:28.287969 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:28.289122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-cfe95146-148c-47eb-9d76-19d70f2e8199 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1599 microversion: 2.20 time: 0.161344 May 09 18:37:28.289691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 325/671] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:37:28 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:28.307187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:28.307733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:28.314420 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.314867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.315641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.316110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.393070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a67f51ee-8a86-40f9-b089-57e5be94b791 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089885 May 09 18:37:28.393657 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 347/672] 10.222.0.35 () {60 vars in 1315 bytes} [Mon May 9 18:37:28 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:37:29.463831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-0525d51c-75cc-4788-aae2-9ee561cfc97c req-05ca9048-9b9a-4cb4-b1a6-ded975c32cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:29.472955 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0525d51c-75cc-4788-aae2-9ee561cfc97c req-05ca9048-9b9a-4cb4-b1a6-ded975c32cba service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.473352 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-0525d51c-75cc-4788-aae2-9ee561cfc97c req-05ca9048-9b9a-4cb4-b1a6-ded975c32cba service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.485610 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-0525d51c-75cc-4788-aae2-9ee561cfc97c req-05ca9048-9b9a-4cb4-b1a6-ded975c32cba service nova] Creating event network-changed:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:37:29.490318 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-0525d51c-75cc-4788-aae2-9ee561cfc97c req-05ca9048-9b9a-4cb4-b1a6-ded975c32cba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030278 May 09 18:37:29.490949 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 326/673] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:47.446916 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:47.447467 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:47.454176 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.454629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.455430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.455836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.480308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9d88115f-c305-4c4c-84c6-80455dc9566a tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/ips" status: 200 len: 149 microversion: 2.1 time: 0.037924 May 09 18:37:47.480918 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 348/674] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:37:47 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:48.803387 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e9e847-f1e1-4fbc-b4b7-0807179244d5"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:48.804600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:48.813966 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.814681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.815929 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.816676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.072743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f5f1604d-c0e9-4000-80d9-8c1199421193 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "POST /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273496 May 09 18:37:49.073441 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 327/675] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:37:48 2022] POST /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:56.709863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:56.710384 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:56.716960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:56.717408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:56.718174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:56.718626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:56.803107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lazy-loading 'services' on Instance uuid 48a61b79-b16a-4d24-bb89-97a54ff7cfeb {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:56.883696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-42f00e03-7bdd-4fa5-a6b2-4fbe3468b1f4 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments/89e9e847-f1e1-4fbc-b4b7-0807179244d5" status: 202 len: 0 microversion: 2.1 time: 0.177812 May 09 18:37:56.884329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 349/676] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:37:56 2022] DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments/89e9e847-f1e1-4fbc-b4b7-0807179244d5 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:37:56.895292 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:56.896402 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:56.903500 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:56.903985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:56.905517 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:56.906130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:56.936937 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b64f4bf3-30d7-42cb-9b1e-c42938962414 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046985 May 09 18:37:56.937527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 328/677] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:37:56 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:57.949745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:57.950813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:57.957660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:57.958109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:57.958911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:57.959353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:57.989283 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1667444a-13ad-4211-bc60-315f213a21fe tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044391 May 09 18:37:57.989826 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 350/678] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:37:57 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:37:58.053060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:58.053611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:58.060239 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:58.060660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:58.061471 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:58.061905 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:58.087690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:37:58.168663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d0ac8238-0e78-41af-b660-66b0d824582c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 204 len: 0 microversion: 2.1 time: 0.119079 May 09 18:37:58.169275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 329/679] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:37:58 2022] DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:37:58.177708 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:58.178426 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:58.184596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:58.185039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:58.185799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:58.186224 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:58.333777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:58.342123 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-942dbc3d-c730-42fa-9029-d1617efab8a5 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1681 microversion: 2.1 time: 0.168312 May 09 18:37:58.342701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 351/680] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:58 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:59.360420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:59.361106 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:59.367964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:59.368432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:59.369211 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:59.369644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:59.507806 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:59.519743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fb31a0d8-4c7d-4692-aba7-45bca254b590 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1681 microversion: 2.1 time: 0.163047 May 09 18:37:59.520890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 330/681] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:37:59 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:00.538064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:00.538755 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:00.545472 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:00.545852 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:00.546648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:00.547073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:00.676975 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b88e2a92518436fb863dc0a41b0f4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79098f9314ff48a7b9a10c4f29df9245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:00.684697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-01325a1b-1a03-4957-b0e5-bc40bd3cdcaa tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 200 len: 1681 microversion: 2.1 time: 0.150586 May 09 18:38:00.685492 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 352/682] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:00 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:01.124118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-5707b134-9a4b-4f2e-946a-92dfc783b0cb req-aaf9a438-0042-4f18-9f93-f85c3fae1d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a61b79-b16a-4d24-bb89-97a54ff7cfeb", "name": "network-vif-deleted", "tag": "3d1d91de-a26e-4130-90aa-df7b0a558865"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:01.133123 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-5707b134-9a4b-4f2e-946a-92dfc783b0cb req-aaf9a438-0042-4f18-9f93-f85c3fae1d13 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:01.133572 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-5707b134-9a4b-4f2e-946a-92dfc783b0cb req-aaf9a438-0042-4f18-9f93-f85c3fae1d13 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:01.145791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-5707b134-9a4b-4f2e-946a-92dfc783b0cb req-aaf9a438-0042-4f18-9f93-f85c3fae1d13 service nova] Creating event network-vif-deleted:3d1d91de-a26e-4130-90aa-df7b0a558865 for instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb on hv-cinder-83588 May 09 18:38:01.150860 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-5707b134-9a4b-4f2e-946a-92dfc783b0cb req-aaf9a438-0042-4f18-9f93-f85c3fae1d13 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030515 May 09 18:38:01.151873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 331/683] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:01.702578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:01.703215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:01.709655 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:01.710100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:01.710881 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:01.711311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:01.727436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb HTTP/1.1 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:38:01.729121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:01.730559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '48a61b79-b16a-4d24-bb89-97a54ff7cfeb'} May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:01.731347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:01.732707 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:01.733856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:01.733856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-88ffa4a3-98fa-45d5-a316-666ec344fe14 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 404 len: 111 microversion: 2.1 time: 0.032246 May 09 18:38:01.733856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 353/684] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:01 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:01.740549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-19dbbf27-5f1f-4a57-a65e-b37dcb7bd6ac tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '.version_select at 0x7fe8bac00430>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:01.759615 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-19dbbf27-5f1f-4a57-a65e-b37dcb7bd6ac tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815781724" status: 202 len: 0 microversion: 2.1 time: 0.023252 May 09 18:38:01.760235 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 332/685] 10.222.0.35 () {58 vars in 1220 bytes} [Mon May 9 18:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815781724 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:38:03.547069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:03.547631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:03.556279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:03.556757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:03.557570 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:03.558007 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:03.572465 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb HTTP/1.1 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:38:03.574070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.575419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '48a61b79-b16a-4d24-bb89-97a54ff7cfeb'} May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:03.576409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.577722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:03.578946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:03.578946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-26e7d9bc-2e12-4de8-b531-c54c30e45b3c tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 404 len: 111 microversion: 2.1 time: 0.033308 May 09 18:38:03.578946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 354/686] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:38:03 2022] DELETE /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:03.588133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:03.589047 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 48a61b79-b16a-4d24-bb89-97a54ff7cfeb] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:03.597351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:03.597800 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:03.598575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:03.599003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:03.613146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb HTTP/1.1 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:38:03.614935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.616550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '48a61b79-b16a-4d24-bb89-97a54ff7cfeb'} May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:03.617380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. May 09 18:38:03.618759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:03.620122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 48a61b79-b16a-4d24-bb89-97a54ff7cfeb could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:03.620122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-845f93c0-5531-4d8f-bb3e-4f50e3c70470 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb" status: 404 len: 111 microversion: 2.1 time: 0.035600 May 09 18:38:03.620122 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 333/687] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:03 2022] GET /compute/v2.1/servers/48a61b79-b16a-4d24-bb89-97a54ff7cfeb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:04.766306 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:04.766909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:04.773923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.774382 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.775187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.775691 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.790059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e HTTP/1.1 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:38:04.791624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.793324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '18727e44-19bd-4c22-848c-9a685d8d235e'} May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:04.794137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.796147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.797865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:04.797865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ee10fe10-302e-48db-b70f-8905120909bb tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 404 len: 111 microversion: 2.1 time: 0.030849 May 09 18:38:04.797865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 355/688] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:38:04 2022] DELETE /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:04.804445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:04.805184 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 18727e44-19bd-4c22-848c-9a685d8d235e] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:04.813553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.813999 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.814991 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.815417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.830882 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e HTTP/1.1 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:38:04.832476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.834012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '18727e44-19bd-4c22-848c-9a685d8d235e'} May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:04.834909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. May 09 18:38:04.836332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.837577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 18727e44-19bd-4c22-848c-9a685d8d235e could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:04.837577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8439d5c7-ed70-4ebb-9081-85cbbcc2d26e tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e" status: 404 len: 111 microversion: 2.1 time: 0.035603 May 09 18:38:04.837577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 334/689] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:04 2022] GET /compute/v2.1/servers/18727e44-19bd-4c22-848c-9a685d8d235e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:04.842661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:04.843169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:04.850257 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.850716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.851491 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.851927 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.865894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 HTTP/1.1 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:38:04.867447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.869868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'e5b93a72-ed01-4edf-a96c-6fcb0391b356'} May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:04.870750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.872427 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:04.873774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:04.873774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6547c7a4-b56e-4175-8996-57586d8a403d tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 404 len: 111 microversion: 2.1 time: 0.030299 May 09 18:38:04.873774 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 356/690] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:38:04 2022] DELETE /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:04.879828 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:04.880779 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: e5b93a72-ed01-4edf-a96c-6fcb0391b356] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:04.889802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.890392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.891160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.892114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.909721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 HTTP/1.1 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:38:04.911241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.912797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e5b93a72-ed01-4edf-a96c-6fcb0391b356'} May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:04.913782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. May 09 18:38:04.915198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:04.916840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance e5b93a72-ed01-4edf-a96c-6fcb0391b356 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:04.916840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2a2303d9-d69c-45d7-8943-2ffad2a38266 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356" status: 404 len: 111 microversion: 2.1 time: 0.038821 May 09 18:38:04.916840 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 335/691] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:04 2022] GET /compute/v2.1/servers/e5b93a72-ed01-4edf-a96c-6fcb0391b356 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:06.070492 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:06.071289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:06.080017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.080480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.081269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.081701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.096346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a HTTP/1.1 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:38:06.097899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.099339 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '8fe2046a-655a-4a12-ad29-1427fa1d4f9a'} May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:06.100443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.102264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:38:06.104353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:06.104353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e7a9514e-1ba3-4c9f-849e-b34be919f006 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 404 len: 111 microversion: 2.1 time: 0.035258 May 09 18:38:06.104353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 357/692] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:38:06 2022] DELETE /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:06.111759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:06.112784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] [instance: 8fe2046a-655a-4a12-ad29-1427fa1d4f9a] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:06.122945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.123393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.124201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.124627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.138532 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] HTTP exception thrown: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Request method failure captured: May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a HTTP/1.1 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV4IFow7UYLufI8WKiCGxhlXLtX5b5XZkNCZUhj7nEK1SqVGuCcWfTdnnRdeh6LbRVgeDM8eeyr9CRlXQrKGvEeCgv_46BVtIAG0UnaIni4RILrrYriLB_XUIYzaihXLNFpdvHWLwukDydqMpjvKui7LHu0Ic_KDc0K1fsDKzkvrDKQ May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:38:06.140083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/79098f9314ff48a7b9a10c4f29df9245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_79098f9314ff48a7b9a10c4f29df9245"}]}] May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 79098f9314ff48a7b9a10c4f29df9245 May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1534371156 May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 3b88e2a92518436fb863dc0a41b0f4f7 May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeNegativeTest-1534371156-project May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.141647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '8fe2046a-655a-4a12-ad29-1427fa1d4f9a'} May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:06.142617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. May 09 18:38:06.144407 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:38:06.145680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] Returning 404 to user: Instance 8fe2046a-655a-4a12-ad29-1427fa1d4f9a could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:06.145680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2ac05a60-3290-4265-8b0e-6d4edf49caf3 tempest-AttachVolumeNegativeTest-1534371156 tempest-AttachVolumeNegativeTest-1534371156-project] 10.222.0.35 "GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a" status: 404 len: 111 microversion: 2.1 time: 0.036247 May 09 18:38:06.145680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 336/693] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:38:06 2022] GET /compute/v2.1/servers/8fe2046a-655a-4a12-ad29-1427fa1d4f9a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:38:12.046984 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-511c523f-089f-45df-8fd0-6219ff55f759 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8babd39d0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:12.096851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-511c523f-089f-45df-8fd0-6219ff55f759 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/f731482e-1376-4afc-909a-4db664d91353" status: 200 len: 351 microversion: 2.1 time: 0.055266 May 09 18:38:12.097418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 358/694] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:38:12 2022] GET /compute/v2.1/os-volumes/f731482e-1376-4afc-909a-4db664d91353 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:13.431567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-030f8c13-80bd-4ee0-989d-abc9cc60a16e tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bac131f0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:13.486087 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-030f8c13-80bd-4ee0-989d-abc9cc60a16e tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/88f92487-86f7-448f-a614-137a208f9866" status: 200 len: 350 microversion: 2.1 time: 0.058260 May 09 18:38:13.486645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 337/695] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:38:13 2022] GET /compute/v2.1/os-volumes/88f92487-86f7-448f-a614-137a208f9866 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:14.008291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:14.008868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:14.016612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:14.017116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:14.017898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:14.018702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:14.041690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-80dd7765-71c1-41bc-8137-d540e24a3d37 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/ips" status: 200 len: 152 microversion: 2.20 time: 0.038309 May 09 18:38:14.042255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 359/696] 10.222.0.35 () {60 vars in 1288 bytes} [Mon May 9 18:38:14 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:38:14.812092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7df1918a-123a-4853-a37d-449acc9da551 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bab9e280>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:14.857816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7df1918a-123a-4853-a37d-449acc9da551 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b71b6b4b-b972-4031-8896-b3988ac8dab7" status: 200 len: 350 microversion: 2.1 time: 0.050010 May 09 18:38:14.858428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 338/697] 10.222.0.35 () {58 vars in 1244 bytes} [Mon May 9 18:38:14 2022] GET /compute/v2.1/os-volumes/b71b6b4b-b972-4031-8896-b3988ac8dab7 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:14.876471 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ff10c027-eb24-49d2-a558-c2adc00717cb tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8babf2e50>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:14.962249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ff10c027-eb24-49d2-a558-c2adc00717cb tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092005 May 09 18:38:14.962821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 360/698] 10.222.0.35 () {58 vars in 1133 bytes} [Mon May 9 18:38:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:14.976977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0b2ba111-fecd-4a94-a0fa-49be237ccb04 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8ba9c41f0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.056557 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0b2ba111-fecd-4a94-a0fa-49be237ccb04 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083362 May 09 18:38:15.057127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 339/699] 10.222.0.35 () {58 vars in 1148 bytes} [Mon May 9 18:38:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:15.074094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b27f05c7-b552-4e0d-b913-975c042fda14 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bab810d0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.157375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b27f05c7-b552-4e0d-b913-975c042fda14 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090097 May 09 18:38:15.157966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 361/700] 10.222.0.35 () {58 vars in 1133 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:15.169373 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8856db55-3b81-4805-8032-4fcbe26fb14a tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bac009d0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.255345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8856db55-3b81-4805-8032-4fcbe26fb14a tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089414 May 09 18:38:15.256208 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 340/701] 10.222.0.35 () {58 vars in 1166 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:15.273740 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-075b1b7d-04dc-42fc-8c58-9f06046e80bf tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bab819d0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.356126 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-075b1b7d-04dc-42fc-8c58-9f06046e80bf tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088992 May 09 18:38:15.356851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 362/702] 10.222.0.35 () {58 vars in 1169 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:15.368837 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0a39d870-6638-4433-b44d-0b5ed6f5e46f tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8ba9e38b0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.448799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0a39d870-6638-4433-b44d-0b5ed6f5e46f tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083816 May 09 18:38:15.449351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 341/703] 10.222.0.35 () {58 vars in 1154 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:15.461221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f9c6b534-df56-42fc-94e7-cddc076c6620 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8babf21f0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.542863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f9c6b534-df56-42fc-94e7-cddc076c6620 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085363 May 09 18:38:15.543504 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 363/704] 10.222.0.35 () {58 vars in 1187 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:15.555546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2b2541a6-88ac-4829-926e-233bd1e8a940 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] Calling method '.version_select at 0x7fe8bab9eee0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:15.637188 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2b2541a6-88ac-4829-926e-233bd1e8a940 tempest-VolumesTestJSON-300492564 tempest-VolumesTestJSON-300492564-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085513 May 09 18:38:15.637768 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 342/705] 10.222.0.35 () {58 vars in 1154 bytes} [Mon May 9 18:38:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:15.839142 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:15.839706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:15.846731 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:15.847183 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:15.847938 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:15.848391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:15.871096 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'flavor' on Instance uuid 71604286-8561-4482-bfb1-02330ae4b1fa {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:38:16.129436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-35489cf9-32e6-45b3-85ef-c1d05b0999c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/action" status: 202 len: 0 microversion: 2.20 time: 0.294124 May 09 18:38:16.130099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 364/706] 10.222.0.35 () {62 vars in 1318 bytes} [Mon May 9 18:38:15 2022] POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:38:16.138887 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:16.139492 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:16.145952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:16.146440 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:16.147172 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:16.147609 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:16.279556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:16.291542 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:16.293854 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:16.295581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-eafdab44-f18d-40a1-a43c-dedcbbe32c3e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.160861 May 09 18:38:16.296985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 343/707] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:16 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:38:17.316088 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:17.316764 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:17.324032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:17.324249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:17.324966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:17.325390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:17.471701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:17.481784 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:17.483278 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:17.484521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ae714355-d941-46ca-a2b0-eb8cd65df4e3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.173522 May 09 18:38:17.485080 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 365/708] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:17 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:18.503160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:18.503773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:18.510860 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:18.511340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:18.512138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:18.512569 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:18.661660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:18.669920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:18.671399 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:18.672626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d7906b38-7c28-45fa-b455-6cde93ee5404 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.173529 May 09 18:38:18.673190 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 344/709] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:18 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:19.691675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:19.692411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:19.699120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:19.699837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:19.700792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:19.701408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:19.859643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:19.867806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:19.869361 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:19.870580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-cd31df49-5a0c-44e3-ae0a-257f9f7c0f36 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.183200 May 09 18:38:19.871544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 366/710] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:19 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:20.889925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:20.890611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:20.897241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:20.897685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:20.898452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:20.898881 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:21.040781 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:21.049014 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:21.050535 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:21.056270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ae959c90-c3f2-405f-92d6-25e000cdb16a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.170136 May 09 18:38:21.056862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 345/711] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:20 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:22.074607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:22.075243 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:22.082095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:22.082540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:22.083310 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:22.083746 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:22.225002 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:22.232847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:22.234462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:22.235644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-46433910-7b3b-4c4c-b27c-03e5bd4e9dc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.165269 May 09 18:38:22.236275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 367/712] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:22 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:23.261156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:23.261796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:23.269280 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:23.269824 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:23.270624 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:23.271071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:23.421858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:23.433312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:23.435488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:23.437254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-380b2bb4-994e-4bc2-b210-9a160ea0ce50 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.180153 May 09 18:38:23.437832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 346/713] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:23 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:24.456371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:24.457232 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:24.466566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:24.467203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:24.468344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:24.469260 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:24.607671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:24.616389 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:24.617872 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:24.619030 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1d5ba87c-625f-4ccf-a615-b24d3c660f53 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.168087 May 09 18:38:24.619605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 368/714] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:24 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:25.641866 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:25.642854 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:25.653959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:25.654694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:25.656163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:25.656593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:25.796865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:25.809953 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:25.812233 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:25.813444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6fbecfd6-726c-42f8-bf4d-c915822caf7c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.178574 May 09 18:38:25.814000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 347/715] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:25 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:26.835615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:26.836343 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:26.846878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:26.847439 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:26.848637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:26.849255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:26.983488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:26.991350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:26.992974 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:26.994120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-16c0c47d-bf50-4418-a851-1de760cf4375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.164672 May 09 18:38:26.994674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 369/716] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:26 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:28.017098 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:28.018526 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:28.029314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:28.030240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:28.031126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:28.031561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:28.166571 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:28.176630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:28.178153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:28.179338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1dbfe7b2-e79e-4c01-b701-019825dff824 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.169050 May 09 18:38:28.179925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 348/717] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:28 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:29.198579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:29.199222 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:29.205973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:29.206397 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:29.207161 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:29.207586 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:29.345882 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:29.357623 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:29.359236 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:29.360448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9c6c24d2-95cf-48db-b21b-dff3ebdcec1a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.165865 May 09 18:38:29.360986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 370/718] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:29 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:30.379093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:30.379770 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:30.386684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:30.387127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:30.387905 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:30.388360 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:30.520196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:30.528380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:30.529883 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:30.531080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6ece0c6e-93c3-43c2-9f83-3c8793313d5e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.156152 May 09 18:38:30.531652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 349/719] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:30 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:31.557300 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:31.557945 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:31.564770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:31.565226 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:31.566002 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:31.566440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:31.703215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:31.711282 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:31.712825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:31.713989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d5ec5d97-9dd4-4482-a654-d092f9001ff7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.160748 May 09 18:38:31.714550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 371/720] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:31 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:32.735693 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:32.736402 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:32.743457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:32.743893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:32.744706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:32.745140 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:32.878620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:32.886647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:32.888179 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:32.889465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5c3eb7d3-e273-4267-ac23-29d015b26821 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1745 microversion: 2.20 time: 0.159406 May 09 18:38:32.890012 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 350/721] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:32 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:33.914305 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:33.915245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:33.925106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:33.925786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:33.926952 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:33.927613 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:34.079379 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:34.094321 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:34.095858 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:34.097095 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-885f1c96-917b-4237-9035-1d7a249532ea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1745 microversion: 2.20 time: 0.188974 May 09 18:38:34.097960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 372/722] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:33 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1745 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:35.115483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:35.116135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:35.122549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:35.123018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:35.123789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:35.124222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:35.263444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:35.274625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:35.276151 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:35.277321 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-97d31105-dd99-453d-9a56-d78033043dc0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.165772 May 09 18:38:35.277886 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 351/723] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:35 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:36.093846 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-01118ce8-6468-4174-b7c1-1717dfdf8518 req-d3d8bcf0-0d46-4469-afbd-902ac519933a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "name": "network-vif-plugged", "status": "completed", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:36.113047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-01118ce8-6468-4174-b7c1-1717dfdf8518 req-d3d8bcf0-0d46-4469-afbd-902ac519933a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:36.113833 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-01118ce8-6468-4174-b7c1-1717dfdf8518 req-d3d8bcf0-0d46-4469-afbd-902ac519933a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:36.125376 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-01118ce8-6468-4174-b7c1-1717dfdf8518 req-d3d8bcf0-0d46-4469-afbd-902ac519933a service nova] Creating event network-vif-plugged:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:38:36.139476 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-01118ce8-6468-4174-b7c1-1717dfdf8518 req-d3d8bcf0-0d46-4469-afbd-902ac519933a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049133 May 09 18:38:36.140127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 373/724] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:38:36.297767 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:36.298420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:36.305707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:36.306819 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:36.308241 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:36.308997 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:36.479778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:36.490916 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:36.492615 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:36.494083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9468ae71-2463-470c-9678-00c02747dd70 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.201939 May 09 18:38:36.494757 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 352/725] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:36 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:37.516168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:37.517026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:37.524431 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:37.525102 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:37.526103 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:37.526532 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:37.680931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:37.689953 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:37.691803 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:37.693020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-18139adb-5c19-4f2f-81ff-edf16c2e20bb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.182057 May 09 18:38:37.693583 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 374/726] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:37 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:38.711615 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:38.713016 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:38.720350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:38.720799 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:38.721570 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:38.722019 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:38.859763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:38.868328 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:38.870026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:38.871310 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-94b46637-f669-4010-b7ef-c36fa45847a1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.163704 May 09 18:38:38.871878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 353/727] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:38 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:39.890729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:39.891311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:39.899555 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:39.900079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:39.900862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:39.901292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:40.062308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:40.071567 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:40.073054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:40.074448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-abd28d82-8d83-4093-aaaf-f02670b52732 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.188052 May 09 18:38:40.075009 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 375/728] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:39 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:41.093054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:41.093664 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:41.103011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:41.103479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:41.104295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:41.104723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:41.244000 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:41.253933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:41.255753 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:41.257282 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-75caaccc-9f1a-40f1-ba6f-adef272db283 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.168103 May 09 18:38:41.258358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 354/729] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:41 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:42.278240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:42.279724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:42.287733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:42.288581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:42.289605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:42.290252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:42.438690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:42.447381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:42.448944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:42.450167 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2e976c54-9251-4cde-95ce-6921797dc1bd tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.176486 May 09 18:38:42.450948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 376/730] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:42 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:38:43.469288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:43.473663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:43.480730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:43.481472 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:43.482445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:43.482984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:43.612622 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:43.620613 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:43.622118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:43.623390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ef242717-5a7d-4302-aa0f-d9dc0504c240 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.158118 May 09 18:38:43.623967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 355/731] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:43 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:44.643157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:44.643806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:44.650714 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:44.651165 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:44.651971 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:44.652399 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:44.780340 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:44.788701 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:44.790214 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:44.791393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f7e15a2d-ec8e-490e-b4f3-03cf4072b2fc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.152808 May 09 18:38:44.791972 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 377/732] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:44 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:45.812710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:45.813412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:45.822249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:45.822841 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:45.823865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:45.824488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:45.973457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:45.985821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:45.988339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:45.990200 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d2f65f40-c8b0-4a8b-b0b4-33b6984a9517 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.182956 May 09 18:38:45.991083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 356/733] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:45 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:47.013754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:47.014820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:47.022244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:47.022695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:47.023460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:47.023894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:47.160631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:47.169039 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:47.170562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:47.171840 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8d64f74c-df58-41be-9644-f98690cc4ab1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1740 microversion: 2.20 time: 0.164670 May 09 18:38:47.172439 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 378/734] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:47 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:48.110171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-6b36903a-2014-429d-a79b-767b06c3455f req-38381a4e-9177-46fb-b1a3-3d9825c68151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:48.134556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6b36903a-2014-429d-a79b-767b06c3455f req-38381a4e-9177-46fb-b1a3-3d9825c68151 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:48.135002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-6b36903a-2014-429d-a79b-767b06c3455f req-38381a4e-9177-46fb-b1a3-3d9825c68151 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:48.152946 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-6b36903a-2014-429d-a79b-767b06c3455f req-38381a4e-9177-46fb-b1a3-3d9825c68151 service nova] Creating event network-vif-unplugged:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:38:48.159675 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-6b36903a-2014-429d-a79b-767b06c3455f req-38381a4e-9177-46fb-b1a3-3d9825c68151 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054325 May 09 18:38:48.160962 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 357/735] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:38:48.197570 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:48.198292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:48.205303 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:48.205762 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:48.206564 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:48.207187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:48.349189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:48.358573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:48.360557 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:48.361815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1bf37a20-a93f-4a7f-a386-31b119cd4c6e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1722 microversion: 2.20 time: 0.168136 May 09 18:38:48.366010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 379/736] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:48 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:49.380820 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:49.381488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:49.389288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:49.389740 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:49.390636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:49.391064 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:49.526255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:49.536192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:49.538438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:49.539935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-90c309d4-e043-4200-b16c-a16c844a0f1e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1722 microversion: 2.20 time: 0.163453 May 09 18:38:49.540543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 358/737] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:49 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:50.559160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:50.559771 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:50.566673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:50.567114 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:50.567873 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:50.568335 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:50.700328 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:50.708579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:50.710082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:50.711252 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1a7b5f0e-70e1-47c5-91d3-b6af2532464b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1725 microversion: 2.20 time: 0.156108 May 09 18:38:50.711805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 380/738] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:50 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:50.729458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c100b8f-9e65-42a9-906f-1c2ef71dd384"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:50.730593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:50.737258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:50.737776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:50.738491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:50.738923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:51.027778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-99408e3b-05a2-4314-952e-914b412b012d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302494 May 09 18:38:51.028503 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 359/739] 10.222.0.35 () {62 vars in 1363 bytes} [Mon May 9 18:38:50 2022] POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:38:51.143261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:51.143831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:51.149687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:51.150136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:51.150904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:51.151404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:51.246521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-de85a1fa-d282-4139-ae46-962e088d2cc9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/action" status: 202 len: 0 microversion: 2.20 time: 0.107628 May 09 18:38:51.250149 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 381/740] 10.222.0.35 () {62 vars in 1318 bytes} [Mon May 9 18:38:51 2022] POST /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:38:51.255398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:51.256049 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:51.262606 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:51.263262 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:51.264068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:51.264504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:51.391869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:51.400453 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:51.401973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:51.403204 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-09dffa4b-c323-492a-8995-75a22ea0d3c1 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1751 microversion: 2.20 time: 0.151747 May 09 18:38:51.403762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 360/741] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:51 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:52.423634 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:52.424281 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:52.430671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:52.431118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:52.431889 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:52.432443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:52.577995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:52.592709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:52.595150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:52.596364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-31f73799-07b1-4b8f-9b62-183ae82f8590 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1753 microversion: 2.20 time: 0.177732 May 09 18:38:52.596924 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 382/742] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:52 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:53.615089 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:53.616304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:53.622793 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:53.623274 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:53.624110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:53.624771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:53.765715 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:53.774337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:53.775892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:53.777093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-09b287c0-12ec-45a3-bcb6-2cbfe46ab668 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.166143 May 09 18:38:53.777660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 361/743] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:53 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:54.794870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:54.795515 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:54.802434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:54.802920 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:54.803693 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:54.804164 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:54.932584 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:54.941023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:54.942523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:54.943677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2a60fc62-be88-403a-bc98-064b3b5485ce tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.152820 May 09 18:38:54.944271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 383/744] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:54 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:55.962474 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:55.963050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:55.970001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:55.970447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:55.971211 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:55.971636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:56.104486 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:56.113210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:56.114707 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:56.115864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2957dc24-2cd9-4583-b538-629a4f9791e7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.157329 May 09 18:38:56.116427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 362/745] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:55 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:57.134412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:57.135240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:57.142657 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:57.155013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:57.168312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:57.169111 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:57.341882 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:57.352851 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:57.354674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:57.356334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a70a79ef-af14-4c7a-a360-323ad0e13dd3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.225706 May 09 18:38:57.368593 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 384/746] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:57 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:58.376623 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:58.377303 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:58.386560 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:58.387288 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:58.388561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:58.389171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:58.594492 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:58.603427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:58.605343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:58.606940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-49d3ebec-d8e1-43aa-9a10-d82b331bd2be tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.234349 May 09 18:38:58.608338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 363/747] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:58 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:38:59.630451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:59.631116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:59.638981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:59.639784 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:59.640838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:59.641780 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:59.854218 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:59.863219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:59.864767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:59.866207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-82b2c2a7-0a11-4978-b6ed-13aefd024d1d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.243802 May 09 18:38:59.867026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 385/748] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:38:59 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:00.902827 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:00.904362 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:00.912204 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:00.913144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:00.914104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:00.914531 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:01.162687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:01.172099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:01.174153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:01.175761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-de32b41a-a5c0-478b-a765-e8a46ffd6b01 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.292662 May 09 18:39:01.187664 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 364/749] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:00 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:02.195690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:02.197212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:02.204384 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:02.204949 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:02.206120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:02.206876 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:02.381422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:02.402778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:02.408883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:02.410963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-cd8d34d0-f205-4dd2-b2d3-ec0581cc7e5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.219944 May 09 18:39:02.411896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 386/750] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:02 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:03.430214 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:03.430802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:03.450965 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:03.451403 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:03.452426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:03.453146 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:03.627725 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:03.636734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:03.639025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:03.640785 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2bb66150-469e-4651-9aa5-bd881440a85d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.214522 May 09 18:39:03.653385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 365/751] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:03 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:04.660853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:04.661484 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:04.668079 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:04.669628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:04.670006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:04.670442 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:04.831078 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:04.840267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:04.841799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:04.844593 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-aab3687b-7b4a-42f2-abbe-16d3e040c2b9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.186296 May 09 18:39:04.844593 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 387/752] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:04 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:05.862857 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:05.863497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:05.870192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:05.870645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:05.871440 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:05.871869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:06.025132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:06.038822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:06.041708 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:06.043677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-15e909c1-ff3d-435c-ade1-d82c5b958d52 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.184967 May 09 18:39:06.044645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 366/753] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:05 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:07.065676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:07.066568 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:07.073348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:07.073789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:07.074647 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:07.074983 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:07.234450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:07.243582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:07.245144 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:07.246311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-171f6c27-1f7a-4abb-b587-84a0787427da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.184850 May 09 18:39:07.246855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 388/754] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:07 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:08.265307 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:08.265915 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:08.275540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:08.276319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:08.277574 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:08.278108 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:08.425151 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:08.434758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:08.436330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:08.437494 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1370f1b6-8f56-4c2b-89a9-607f6892285a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.176156 May 09 18:39:08.438057 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 367/755] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:08 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:09.459139 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:09.459776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:09.468229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:09.468702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:09.469560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:09.470144 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:09.613445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:09.623267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:09.624811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:09.625981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e9ce2d82-234e-46b8-b658-3df6009abab6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.173143 May 09 18:39:09.626546 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 389/756] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:09 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:10.648720 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:10.649267 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:10.656299 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:10.656762 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:10.657538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:10.658003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:10.804505 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:10.813668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:10.815446 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:10.816802 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2b546af2-64ca-447c-aaef-20370023aca4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.172232 May 09 18:39:10.817444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 368/757] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:10 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:11.838831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:11.839685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:11.847153 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:11.847606 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:11.848435 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:11.848865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:11.998814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:12.007919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:12.009487 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:12.010709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7912e54c-faf9-43d7-843c-ca720135cc2f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.176235 May 09 18:39:12.011485 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 390/758] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:11 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:39:13.030483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:13.031043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:13.038711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:13.039165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:13.040041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:13.040501 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:13.191559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:13.204513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:13.207297 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:13.209410 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8439268d-b163-4eea-805f-7149db675729 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.183108 May 09 18:39:13.210617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 369/759] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:13 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:14.232291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:14.233049 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:14.240346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:14.240844 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:14.241799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:14.242242 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:14.361811 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-7a078957-cf58-4579-9cb6-81d16c1140a5 req-2ea3748e-675c-46b0-8b94-f6f1d0a78af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "name": "network-vif-plugged", "status": "completed", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:14.370805 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-7a078957-cf58-4579-9cb6-81d16c1140a5 req-2ea3748e-675c-46b0-8b94-f6f1d0a78af7 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:14.371528 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-7a078957-cf58-4579-9cb6-81d16c1140a5 req-2ea3748e-675c-46b0-8b94-f6f1d0a78af7 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:14.384776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-7a078957-cf58-4579-9cb6-81d16c1140a5 req-2ea3748e-675c-46b0-8b94-f6f1d0a78af7 service nova] Creating event network-vif-plugged:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:39:14.396647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-7a078957-cf58-4579-9cb6-81d16c1140a5 req-2ea3748e-675c-46b0-8b94-f6f1d0a78af7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033547 May 09 18:39:14.396647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 370/760] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:39:14.397373 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:14.406790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:14.408325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:14.409530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-137af663-ec1b-47a3-87ca-b54d0a7ee90f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.181569 May 09 18:39:14.415354 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 391/761] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:14 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:15.429598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:15.430426 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:15.437579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:15.438028 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:15.438824 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:15.439276 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:15.590136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:15.599488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:15.601026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:15.602194 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9c7b08c6-e34c-419f-9a93-dfaf255bae18 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.177068 May 09 18:39:15.602780 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 371/762] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:15 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:16.622629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:16.623678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:16.630912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:16.631364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:16.632210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:16.632671 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:16.771290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:16.780905 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:16.783405 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:16.784711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c58a8eb5-48dc-4a03-a70e-b65b7f50fb03 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1809 microversion: 2.20 time: 0.167590 May 09 18:39:16.785483 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 392/763] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:16 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:17.804877 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:17.805536 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:17.813157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:17.813613 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:17.814392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:17.814832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:17.976451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:17.986465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:17.988013 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:17.989243 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e60fc5cd-b238-4294-8da3-d1a74fdd0fca tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1796 microversion: 2.20 time: 0.188931 May 09 18:39:17.989794 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 372/764] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:17 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1796 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:39:21.061316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:21.061990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:21.068574 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.069022 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.069794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.070227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.097878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:39:21.187337 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f88071a2-f80a-49cf-9f25-b16d636554eb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "DELETE /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 204 len: 0 microversion: 2.1 time: 0.129570 May 09 18:39:21.187942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 393/765] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:39:21 2022] DELETE /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:39:21.196314 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:21.196869 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:21.203924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.204414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.205171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.205596 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.362516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:21.371185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f290ffea-de28-4da8-a609-8ce2f69863cf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1579 microversion: 2.1 time: 0.178642 May 09 18:39:21.371776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 373/766] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:21 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:22.392260 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:22.393147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:22.400468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:22.400935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:22.401720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:22.402160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:22.558667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:22.566813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5b384d84-ce43-4cef-852f-4eaccd8109ab tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1579 microversion: 2.1 time: 0.181148 May 09 18:39:22.567475 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 394/767] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:22 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:23.585925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:23.586566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:23.599556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:23.600088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:23.600970 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:23.601476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:23.666909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:23.674986 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-273a21bf-5587-40cd-8eb9-d462b56a8a2e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 200 len: 1511 microversion: 2.1 time: 0.093132 May 09 18:39:23.675577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 374/768] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:23 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:23.875842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-018ea253-95a0-471c-b7d0-4508daeb215c req-e94fd682-ed0a-44a4-85a2-01b3572e3bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297d06a6-18b9-45b0-9bbe-91cbb3667fa7", "name": "network-vif-deleted", "tag": "7c668d56-62b3-465e-b8b4-741373748f28"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:23.888730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-018ea253-95a0-471c-b7d0-4508daeb215c req-e94fd682-ed0a-44a4-85a2-01b3572e3bc1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:23.888730 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-018ea253-95a0-471c-b7d0-4508daeb215c req-e94fd682-ed0a-44a4-85a2-01b3572e3bc1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:23.910365 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-018ea253-95a0-471c-b7d0-4508daeb215c req-e94fd682-ed0a-44a4-85a2-01b3572e3bc1 service nova] Creating event network-vif-deleted:7c668d56-62b3-465e-b8b4-741373748f28 for instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 on hv-cinder-83588 May 09 18:39:23.916862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-018ea253-95a0-471c-b7d0-4508daeb215c req-e94fd682-ed0a-44a4-85a2-01b3572e3bc1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045353 May 09 18:39:23.917794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 395/769] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:24.692835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:24.693452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:24.700575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:24.701109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:24.701960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:24.702339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:24.717752 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] HTTP exception thrown: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Request method failure captured: May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 HTTP/1.1 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV8xxoRTaa-aFmqstUUkR1fjLHOkLMe-5MesavmvB6F3tJNSIKkYb2e_0aBpJij7DXz-Z8Gq_84mAcn2Cci8rlsbTd3JpUAMcL8HlzjngHoJm4qwwCcDdPy-qiM8aDxEl5SbKgFXMZqcWhUQTch9mF13h0GrZzqz7KZDxWiK5fkIbyY May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:39:24.719691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9292fda06d234de8b60b0131b87bbf46"}]}] May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-TestVolumeBootPattern-1011275184 May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-TestVolumeBootPattern-1011275184-project May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 86609452d1a44c9d953ed642936003f1 May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-TestVolumeBootPattern-1011275184-project May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:39:24.721455 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '297d06a6-18b9-45b0-9bbe-91cbb3667fa7'} May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:39:24.731567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:39:24.733117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:39:24.734248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Returning 404 to user: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:39:24.734248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-077cf04d-eda2-43b9-b298-051beb4179b2 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 404 len: 111 microversion: 2.1 time: 0.032485 May 09 18:39:24.734248 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 375/770] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:24 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:39:24.904875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-38967685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006085322", "security_groups": [{"name": "tempest-secgroup-smoke-1009084773"}], "block_device_mapping_v2": [{"uuid": "635a551c-6a9b-41a2-82de-c8665a49b630", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9626c38-13d9-423a-9810-cc67a8569feb"}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:25.026906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] validate_networks() for [('b9626c38-13d9-423a-9810-cc67a8569feb', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:39:25.420793 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:39:25.421320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:39:25.421831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:39:25.422241 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:39:25.422661 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:39:25.434212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:25.434669 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:25.435545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:25.435942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:25.453627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:39:25.458005 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for user 86609452d1a44c9d953ed642936003f1 and project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:39:25.520708 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:39:25.521472 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='635a551c-6a9b-41a2-82de-c8665a49b630',volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:39:25.660234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-abf7e483-82b1-4ece-8527-de4e60eee421 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763131 May 09 18:39:25.660885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 396/771] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:39:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 18:39:25.671387 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a525eac2-d1c0-4c1b-853a-ab645fcd78a3 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:25.672055 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a525eac2-d1c0-4c1b-853a-ab645fcd78a3 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:25.726693 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a525eac2-d1c0-4c1b-853a-ab645fcd78a3 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:25.733394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a525eac2-d1c0-4c1b-853a-ab645fcd78a3 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1093 microversion: 2.1 time: 0.066340 May 09 18:39:25.733988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 376/772] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:25 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:26.750957 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:26.752350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:26.758831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:26.759284 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:26.760124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:26.760560 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:26.836992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:26.848020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-727440e9-8004-4c13-8220-e0512ff18741 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1209 microversion: 2.1 time: 0.098261 May 09 18:39:26.848020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 397/773] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:26 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:39:27.867650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:27.868308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:27.877145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:27.877873 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:27.878691 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:27.879362 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.081470 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:28.094958 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ba711a44-2791-4347-a860-0c17f9c9740e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.231728 May 09 18:39:28.103283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 377/774] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:27 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:28.170255 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-9515b9b2-09a0-4290-a9d3-511678df1b03 req-ca03530f-324c-4144-8462-19b0fd3c857e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c381236c-6ccf-420b-be56-4f499d767474", "tag": "ac0bd851-ca4d-4d0c-8d7b-b047915f11f1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:28.180682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-9515b9b2-09a0-4290-a9d3-511678df1b03 req-ca03530f-324c-4144-8462-19b0fd3c857e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.181444 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-9515b9b2-09a0-4290-a9d3-511678df1b03 req-ca03530f-324c-4144-8462-19b0fd3c857e service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.194585 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-9515b9b2-09a0-4290-a9d3-511678df1b03 req-ca03530f-324c-4144-8462-19b0fd3c857e service nova] Creating event network-changed:ac0bd851-ca4d-4d0c-8d7b-b047915f11f1 for instance c381236c-6ccf-420b-be56-4f499d767474 on hv-cinder-83588 May 09 18:39:28.201071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-9515b9b2-09a0-4290-a9d3-511678df1b03 req-ca03530f-324c-4144-8462-19b0fd3c857e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034825 May 09 18:39:28.201970 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 398/775] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:39:29.121506 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:29.122114 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:29.137851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:29.138287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:29.139070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:29.139505 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:29.325512 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:29.335329 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-02f1cabd-24d2-4ba6-affd-9f75713e1be8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.217751 May 09 18:39:29.335904 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 378/776] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:29 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:30.360473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:30.361192 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:30.367788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:30.368673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:30.369407 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:30.369970 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:30.518640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:30.526082 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-42771bcd-a073-4320-b5db-90a28d98a04e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.170530 May 09 18:39:30.526670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 399/777] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:30 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:31.543642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:31.544290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:31.551332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:31.551774 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:31.552586 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:31.552992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:31.694518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:31.702566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b9b64961-874c-44a6-ad30-20574075b2ad tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.162903 May 09 18:39:31.703157 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 379/778] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:31 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:32.721501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:32.722099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:32.730143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:32.730683 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:32.731673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:32.732445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:32.883356 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:32.891817 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bd9a6777-7acc-4fea-8dc9-efe97e60c3b1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.174684 May 09 18:39:32.892443 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 400/779] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:32 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:33.910271 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:33.910911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:33.918732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:33.919443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:33.920738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:33.921187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:34.106985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:34.119500 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6cbacf41-0669-4af8-9509-da165d61ce5a tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.212731 May 09 18:39:34.120649 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 380/780] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:33 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:35.144003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:35.144620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:35.151644 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:35.152236 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:35.153069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:35.153497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:35.309263 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:35.318327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a6c47ad0-8d29-4c6a-97f8-a0ee28a33122 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.179024 May 09 18:39:35.319133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 401/781] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:35 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:36.335621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:36.336418 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:36.343468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:36.343967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:36.344829 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:36.345261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:36.496297 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:36.503993 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f76e085f-36b7-482a-9ced-25da61d11218 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.172218 May 09 18:39:36.504885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 381/782] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:36 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:37.522090 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:37.523104 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:37.531746 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:37.532546 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:37.533336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:37.533782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:37.672827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:37.681989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e1a6e160-a12a-4a99-8b36-5c20571ab1e7 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.163722 May 09 18:39:37.682778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 402/783] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:37 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:38.701100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:38.701676 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:38.708684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:38.709278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:38.709909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:38.710344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:38.860419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:38.868404 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-47e85fd7-3ab8-4876-a85c-a522e3eb36a8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.172843 May 09 18:39:38.868992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 382/784] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:38 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:39.885830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:39.886441 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:39.893753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:39.894190 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:39.894967 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:39.895375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:40.040550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:40.049021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5d71d6f0-c907-49ca-b95d-f3261222507e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.167032 May 09 18:39:40.049658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 403/785] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:39 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:41.066763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:41.067657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:41.074190 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.074636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.075722 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.076447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.213785 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:41.221619 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2c5744c7-0df7-48c4-b3b9-597be87bc276 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.158974 May 09 18:39:41.222200 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 383/786] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:41 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:42.239063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:42.239713 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:42.246392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:42.246830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:42.247629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:42.248084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:42.392923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:42.400769 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-33939500-e265-4330-9bf6-bd12f7f5211f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.165585 May 09 18:39:42.401341 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 404/787] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:42 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:43.417247 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:43.417844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:43.427886 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:43.428650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:43.429900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:43.430372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:43.565349 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:43.574835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1e228567-3bab-4cd6-af98-c9060ec1e0c5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.161262 May 09 18:39:43.575825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 384/788] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:43 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:43.744244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-44eae583-2ad3-4197-88ab-9f4fd03588ae req-54972448-9a4b-433f-97b2-34f4eb1d59a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c381236c-6ccf-420b-be56-4f499d767474", "name": "network-vif-plugged", "status": "completed", "tag": "ac0bd851-ca4d-4d0c-8d7b-b047915f11f1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:43.754488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-44eae583-2ad3-4197-88ab-9f4fd03588ae req-54972448-9a4b-433f-97b2-34f4eb1d59a6 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:43.755086 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-44eae583-2ad3-4197-88ab-9f4fd03588ae req-54972448-9a4b-433f-97b2-34f4eb1d59a6 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:43.774650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-44eae583-2ad3-4197-88ab-9f4fd03588ae req-54972448-9a4b-433f-97b2-34f4eb1d59a6 service nova] Creating event network-vif-plugged:ac0bd851-ca4d-4d0c-8d7b-b047915f11f1 for instance c381236c-6ccf-420b-be56-4f499d767474 on hv-cinder-83588 May 09 18:39:43.782060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-44eae583-2ad3-4197-88ab-9f4fd03588ae req-54972448-9a4b-433f-97b2-34f4eb1d59a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 May 09 18:39:43.782911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 405/789] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:44.593448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:44.594305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:44.604522 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:44.605278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:44.606595 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:44.607302 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:44.747069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:44.754997 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-73ffb0ad-1ce6-413a-bcab-04fc2c3fcbaf tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1265 microversion: 2.1 time: 0.166425 May 09 18:39:44.755583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 385/790] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:44 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:45.773311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:45.774021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:45.781568 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:45.782333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:45.783159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:45.783544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:45.928609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:45.936257 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d69973b2-0310-4b95-ac33-a9123bbad52b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1452 microversion: 2.1 time: 0.167166 May 09 18:39:45.936911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 406/791] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:45 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:45.956825 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:45.957397 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:45.963928 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:45.965169 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:45.965638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:45.966071 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:46.115620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:46.123771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-df55c6d5-f36d-4ae6-ae40-84a1c0d3ff1e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1452 microversion: 2.1 time: 0.170856 May 09 18:39:46.124433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 386/792] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:39:45 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:48.152573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-1936107b-f81b-4321-8702-395618283560 req-d448db40-e8d9-4458-8135-7ae3ad0d8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c381236c-6ccf-420b-be56-4f499d767474", "tag": "ac0bd851-ca4d-4d0c-8d7b-b047915f11f1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:48.161653 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-1936107b-f81b-4321-8702-395618283560 req-d448db40-e8d9-4458-8135-7ae3ad0d8c55 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:48.162119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-1936107b-f81b-4321-8702-395618283560 req-d448db40-e8d9-4458-8135-7ae3ad0d8c55 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:48.173567 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-1936107b-f81b-4321-8702-395618283560 req-d448db40-e8d9-4458-8135-7ae3ad0d8c55 service nova] Creating event network-changed:ac0bd851-ca4d-4d0c-8d7b-b047915f11f1 for instance c381236c-6ccf-420b-be56-4f499d767474 on hv-cinder-83588 May 09 18:39:48.179210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-1936107b-f81b-4321-8702-395618283560 req-d448db40-e8d9-4458-8135-7ae3ad0d8c55 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 May 09 18:39:48.180119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 407/793] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:54.824598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:39:54.825061 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:39:57.857529 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:57.858207 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:57.864416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:57.864865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:57.865640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:57.866072 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:57.908952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-44bb0cfc-ecdb-408c-a5da-4f1f47410880 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments/5c100b8f-9e65-42a9-906f-1c2ef71dd384" status: 200 len: 194 microversion: 2.20 time: 0.055790 May 09 18:39:57.909540 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 387/794] 10.222.0.35 () {60 vars in 1453 bytes} [Mon May 9 18:39:57 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments/5c100b8f-9e65-42a9-906f-1c2ef71dd384 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:39:57.988450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:57.989053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:57.995861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:57.996335 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:57.997112 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:57.997547 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:58.088216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'services' on Instance uuid 71604286-8561-4482-bfb1-02330ae4b1fa {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:39:58.167853 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d0151a23-7678-4a66-ae03-e307ec4c2e96 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments/5c100b8f-9e65-42a9-906f-1c2ef71dd384" status: 202 len: 0 microversion: 2.20 time: 0.183568 May 09 18:39:58.171752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 408/795] 10.222.0.35 () {60 vars in 1456 bytes} [Mon May 9 18:39:57 2022] DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments/5c100b8f-9e65-42a9-906f-1c2ef71dd384 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:39:58.178521 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:58.179596 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:58.186283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:58.186864 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:58.187650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:58.188575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:58.230702 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c77d6e3f-0960-4afb-a904-b6205f3ccfea tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057325 May 09 18:39:58.231294 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 388/796] 10.222.0.35 () {60 vars in 1342 bytes} [Mon May 9 18:39:58 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:39:59.246824 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:59.247744 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:59.255201 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.255645 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.256465 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.256909 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.287615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e8eee063-1761-4114-9c00-42a575338389 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045930 May 09 18:39:59.288249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 409/797] 10.222.0.35 () {60 vars in 1342 bytes} [Mon May 9 18:39:59 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:59.351216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:59.352221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:59.358774 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.359231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.360050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.360467 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.389041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:39:59.467182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-03674418-e827-47d2-ad9c-b5fadb4d3f91 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 204 len: 0 microversion: 2.20 time: 0.119531 May 09 18:39:59.468082 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 389/798] 10.222.0.35 () {60 vars in 1279 bytes} [Mon May 9 18:39:59 2022] DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:39:59.476375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:59.477003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:59.483567 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.484047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.484938 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:59.485504 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:59.628212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:59.637214 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:59.638847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:59.640501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-72e4270e-cafb-4257-9ca2-b4be7e7de4bc tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.167839 May 09 18:39:59.641069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 410/799] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:39:59 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:00.660740 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:00.661446 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:00.675295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:00.675295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:00.675295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:00.675295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:00.827541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:00.836210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:00.837733 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:00.839133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b7fd2819-96df-4e60-9e7a-70fca05f2130 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1724 microversion: 2.20 time: 0.182947 May 09 18:40:00.839688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 390/800] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:00 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:01.858364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:01.859075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:01.865582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:01.866045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:01.866874 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:01.867308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:01.940347 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:01.948790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:01.950616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:01.951875 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-dea966e1-0a95-4131-be74-1fa450ea8b28 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1657 microversion: 2.20 time: 0.097947 May 09 18:40:01.952775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 411/801] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:01 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1657 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:02.455152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-1a9610cb-cc76-47d4-a7ef-ac0d01ce7e7c req-5c0013be-14fa-479d-8903-93dd7b36684f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71604286-8561-4482-bfb1-02330ae4b1fa", "name": "network-vif-deleted", "tag": "a2ed12c4-850e-4d68-94af-40a2980e38b2"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:02.463317 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-1a9610cb-cc76-47d4-a7ef-ac0d01ce7e7c req-5c0013be-14fa-479d-8903-93dd7b36684f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.464265 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-1a9610cb-cc76-47d4-a7ef-ac0d01ce7e7c req-5c0013be-14fa-479d-8903-93dd7b36684f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.476807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-1a9610cb-cc76-47d4-a7ef-ac0d01ce7e7c req-5c0013be-14fa-479d-8903-93dd7b36684f service nova] Creating event network-vif-deleted:a2ed12c4-850e-4d68-94af-40a2980e38b2 for instance 71604286-8561-4482-bfb1-02330ae4b1fa on hv-cinder-83588 May 09 18:40:02.486816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-1a9610cb-cc76-47d4-a7ef-ac0d01ce7e7c req-5c0013be-14fa-479d-8903-93dd7b36684f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037631 May 09 18:40:02.488243 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 391/802] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:40:02.971977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:02.972712 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:02.980145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.980706 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.981627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.982137 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:03.017175 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:03.017771 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:03.018017 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'fault' on Instance uuid 71604286-8561-4482-bfb1-02330ae4b1fa {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:03.060826 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:03.069757 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:03.071304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:03.072574 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-762ea480-d950-4285-9989-d54f4831fcd5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1372 microversion: 2.20 time: 0.104841 May 09 18:40:03.073180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 412/803] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:02 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:04.093109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:04.093883 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:04.100805 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.101261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.102054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.102493 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.142856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.142856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.143284 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'fault' on Instance uuid 71604286-8561-4482-bfb1-02330ae4b1fa {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:04.190550 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:04.199709 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:04.201341 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:04.202567 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0881720f-648c-47aa-909d-c587ee000860 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1372 microversion: 2.20 time: 0.114391 May 09 18:40:04.203154 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 392/804] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:04 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:05.221231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:05.221950 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:05.229213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.229759 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.230643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.231627 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.266508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.266944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.267430 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'fault' on Instance uuid 71604286-8561-4482-bfb1-02330ae4b1fa {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:05.310381 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:05.318349 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:05.319877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:05.321199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f72c0d05-a363-43fe-9b68-446f52979110 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 200 len: 1372 microversion: 2.20 time: 0.103957 May 09 18:40:05.331941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 413/805] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:05 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:40:06.342813 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:06.343581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:06.353178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.354189 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.355757 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.356588 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.372717 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa HTTP/1.1 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:40:06.374390 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:40:06.376133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '71604286-8561-4482-bfb1-02330ae4b1fa'} May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:40:06.377030 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:40:06.378351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:40:06.379546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:40:06.379546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1d96a8ae-022a-4ba5-b388-40d3d6f1217e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 404 len: 111 microversion: 2.20 time: 0.038023 May 09 18:40:06.379546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 393/806] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:06 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:40:06.385715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2d28d960-e8b7-42e2-b9bc-113e62a5bdc4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '.version_select at 0x7fe8c3e2d940>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:06.413964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2d28d960-e8b7-42e2-b9bc-113e62a5bdc4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808167085" status: 204 len: 0 microversion: 2.20 time: 0.032159 May 09 18:40:06.414813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 414/807] 10.222.0.35 () {60 vars in 1261 bytes} [Mon May 9 18:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808167085 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:40:07.147701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-51bfc482-79ae-497d-ba6b-f324731549d5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: .version_select at 0x7fe8ba977790>, body: {"keypair": {"name": "tempest-keypair-1046420334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPwP9xe9R11ymDObc3qgJdt7S/v9r+rM54YyOLhXmx0UosiOo/A9astbJYh5ylUSj3XY4c+1uSg0e4YjLH/lgsoMjSUniiAyDpUbNqWJU+QxQFrIeLjYugmWMFW77XU/g=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:07.181144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-51bfc482-79ae-497d-ba6b-f324731549d5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for project 149f6b903b8f4fb688927a1234efa295. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:40:07.186158 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-51bfc482-79ae-497d-ba6b-f324731549d5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for user 890667c36f9646b1a9fcc907f28b4b1b and project 149f6b903b8f4fb688927a1234efa295. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:40:07.212911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-51bfc482-79ae-497d-ba6b-f324731549d5 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.069315 May 09 18:40:07.213622 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 394/808] 10.222.0.35 () {62 vars in 1199 bytes} [Mon May 9 18:40:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 18:40:08.896044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-924258965", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5852b8c9-f3ae-4859-9362-6cdfd85a956c"}], "security_groups": [{"name": "tempest-securitygroup--1452369000"}], "key_name": "tempest-keypair-1046420334", "user_data": "}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:09.018870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] validate_networks() for [('5852b8c9-f3ae-4859-9362-6cdfd85a956c', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:40:09.429951 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:40:09.430534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:40:09.431272 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:40:09.431839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:40:09.432684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:40:09.442913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.443590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.445015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.445470 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.464395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for project 149f6b903b8f4fb688927a1234efa295. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:40:09.468680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Getting quotas for user 890667c36f9646b1a9fcc907f28b4b1b and project 149f6b903b8f4fb688927a1234efa295. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:40:09.481470 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:40:09.483931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:40:09.538930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-456fb712-d9ed-488d-94b5-4822acfe9396 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647412 May 09 18:40:09.540145 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 415/809] 10.222.0.35 () {62 vars in 1187 bytes} [Mon May 9 18:40:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 18:40:09.552290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:09.553945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:09.611466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:09.618549 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:09.620062 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:09.621175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-acce6bb8-ba1e-427c-b771-393781c7e9d6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1281 microversion: 2.20 time: 0.074139 May 09 18:40:09.621757 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 395/810] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:09 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:40:10.639455 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:10.640373 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:10.647653 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.648231 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.649001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.649438 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.711694 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:10.722316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:10.724154 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:10.725307 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-07f2695a-fe07-466c-a915-d4e6e04f5087 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1333 microversion: 2.20 time: 0.090394 May 09 18:40:10.726031 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 416/811] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:10 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:11.744391 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:11.745399 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:11.760511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.760971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.761751 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.762214 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.926007 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:11.935492 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:11.937037 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:11.938400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0bea993a-3530-4bc3-a920-ad3ffa00b70d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.197816 May 09 18:40:11.938960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 396/812] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:11 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:12.311936 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-4880cabf-f807-4dc3-ae25-2294ed4e74e2 req-2d51e888-1fda-417b-a78f-0f15bc696e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:12.337934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-4880cabf-f807-4dc3-ae25-2294ed4e74e2 req-2d51e888-1fda-417b-a78f-0f15bc696e44 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:12.338380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-4880cabf-f807-4dc3-ae25-2294ed4e74e2 req-2d51e888-1fda-417b-a78f-0f15bc696e44 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:12.358677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-4880cabf-f807-4dc3-ae25-2294ed4e74e2 req-2d51e888-1fda-417b-a78f-0f15bc696e44 service nova] Creating event network-changed:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:40:12.369625 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-4880cabf-f807-4dc3-ae25-2294ed4e74e2 req-2d51e888-1fda-417b-a78f-0f15bc696e44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063788 May 09 18:40:12.370483 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 417/813] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:12.962351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:12.962939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:12.969677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:12.970138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:12.971004 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:12.971450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:13.110922 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:13.119223 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:13.120761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:13.121868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2e674299-7314-4ccf-bb4c-183b792f681d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.163508 May 09 18:40:13.122427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 397/814] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:12 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:14.148116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:14.148861 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:14.156054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.156512 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.157448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.157880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.317811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:14.330646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:14.333229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:14.335064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c274b729-040f-419c-a1d5-64dedd6812f9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.192912 May 09 18:40:14.335911 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 418/815] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:14 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:15.355196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:15.355783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:15.363346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.363842 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.364754 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.365264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.514448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:15.523278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:15.524795 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:15.525945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-dd7b3a9d-65ca-4c2c-bda3-162b9f1206fe tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.175086 May 09 18:40:15.526487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 398/816] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:15 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:16.545023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:16.545656 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:16.552624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.553073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.553830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.554261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.705565 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:16.714166 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:16.715781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:16.716944 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0d66a3e2-1838-4e11-acb1-15963bf5ceac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.176406 May 09 18:40:16.717529 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 419/817] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:16 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:17.737808 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:17.738340 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:17.745719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.746165 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.746955 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.747400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.910650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:17.918870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:17.920743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:17.921897 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5ebcee4a-2b51-4f85-97c7-46c97643a67c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.189179 May 09 18:40:17.922176 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-c46b89c3-b223-4169-bae6-142c57f1d508 req-8cbf1707-e603-4814-93a8-de399ccfcc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "name": "network-vif-plugged", "status": "completed", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:17.933258 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-c46b89c3-b223-4169-bae6-142c57f1d508 req-8cbf1707-e603-4814-93a8-de399ccfcc00 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.934276 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-c46b89c3-b223-4169-bae6-142c57f1d508 req-8cbf1707-e603-4814-93a8-de399ccfcc00 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.934939 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 399/818] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:17 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:17.949458 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-c46b89c3-b223-4169-bae6-142c57f1d508 req-8cbf1707-e603-4814-93a8-de399ccfcc00 service nova] Creating event network-vif-plugged:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:40:17.954453 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-c46b89c3-b223-4169-bae6-142c57f1d508 req-8cbf1707-e603-4814-93a8-de399ccfcc00 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036155 May 09 18:40:17.955067 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 420/819] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:18.940543 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:18.941190 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:18.948101 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:18.948553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:18.949343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:18.949785 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:19.093581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:19.103198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:19.104750 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:19.105885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ba333303-b762-4efc-b3de-1005c575b2a3 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1407 microversion: 2.20 time: 0.169590 May 09 18:40:19.106445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 400/820] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:18 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:20.124545 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:20.125312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:20.132937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.133383 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.134171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.134596 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.286301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:20.295338 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:20.296926 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:20.298123 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-39088d3b-5115-4048-938c-283777fa3932 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1599 microversion: 2.20 time: 0.177988 May 09 18:40:20.298650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 421/821] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:20 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:40:20.317746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:20.318883 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:20.326650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.327263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.328989 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.329432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.421844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e5ffd0c4-3110-43a4-9059-a0d1fc7b1335 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109843 May 09 18:40:20.422447 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 401/822] 10.222.0.35 () {60 vars in 1315 bytes} [Mon May 9 18:40:20 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:40:21.487790 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-685759f3-7ed4-4d52-b74e-b4fb307c0d2e req-70986b83-0ae7-4155-8176-545981d48908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:21.497105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-685759f3-7ed4-4d52-b74e-b4fb307c0d2e req-70986b83-0ae7-4155-8176-545981d48908 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:21.497551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-685759f3-7ed4-4d52-b74e-b4fb307c0d2e req-70986b83-0ae7-4155-8176-545981d48908 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:21.509151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-685759f3-7ed4-4d52-b74e-b4fb307c0d2e req-70986b83-0ae7-4155-8176-545981d48908 service nova] Creating event network-changed:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:40:21.514813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-685759f3-7ed4-4d52-b74e-b4fb307c0d2e req-70986b83-0ae7-4155-8176-545981d48908 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030512 May 09 18:40:21.515852 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 422/823] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:57.375308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:57.375992 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:57.382431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:57.382999 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:57.383782 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:57.384260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:57.408502 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-bca0ecf8-a3c2-4408-8e85-f4b73c1768f7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/ips" status: 200 len: 152 microversion: 2.20 time: 0.037803 May 09 18:40:57.409069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 402/824] 10.222.0.35 () {60 vars in 1288 bytes} [Mon May 9 18:40:57 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:40:59.212151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:59.212775 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:59.219448 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.219892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.220687 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.221112 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.244125 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.objects.instance [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lazy-loading 'flavor' on Instance uuid 6818fe6b-718d-4966-b373-d9f7e994b810 {{(pid=118351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:59.502209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-45fa40ab-6f11-40f4-bab6-e65a019879f4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/action" status: 202 len: 0 microversion: 2.20 time: 0.294978 May 09 18:40:59.502847 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 423/825] 10.222.0.35 () {62 vars in 1318 bytes} [Mon May 9 18:40:59 2022] POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:40:59.511334 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:59.511967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:59.518902 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.519334 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.520140 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.520600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.656293 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:59.665084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:59.666594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:59.667790 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8d1490f2-00dc-4cf7-b119-682fac97439f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.160521 May 09 18:40:59.668408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 403/826] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:40:59 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:00.688238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:00.688955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:00.695892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:00.696375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:00.697198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:00.697643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:00.830519 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:00.838745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:00.840322 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:00.841502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-aaf12c54-fadb-4d66-b5c0-6714a6d5685e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.158157 May 09 18:41:00.842072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 424/827] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:00 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:01.861118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:01.861780 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:01.869400 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:01.869849 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:01.870646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:01.871083 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:02.003307 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:02.012353 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:02.014183 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:02.015359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3e1d3453-5335-473c-b94c-5874716e1de4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.158444 May 09 18:41:02.015918 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 404/828] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:01 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:03.034973 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:03.035540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:03.042274 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:03.042729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:03.043496 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:03.043930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:03.179221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:03.188885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:03.190442 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:03.191685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3f58036a-152a-4432-ae09-934cbe6d4d30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.160793 May 09 18:41:03.192609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 425/829] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:03 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:04.211480 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:04.212163 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:04.218853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:04.219306 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:04.220116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:04.220553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:04.361619 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:04.370153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:04.371685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:04.372936 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-72e502a0-c029-43ae-afac-89f10b11b562 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.165697 May 09 18:41:04.373491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 405/830] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:04 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:05.392297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:05.392934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:05.400134 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:05.400573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:05.401351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:05.401778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:05.550351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:05.564260 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:05.566571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:05.567810 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bd7ac6d7-b0b7-4c4e-9076-99ede3c1ae60 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.179904 May 09 18:41:05.568396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 426/831] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:05 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:06.588783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:06.589437 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:06.597311 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:06.597812 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:06.598625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:06.599064 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:06.745764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:06.758893 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:06.761309 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:06.763481 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5209c0b8-c9e5-4b2b-994b-6ebcebd86766 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.179475 May 09 18:41:06.764361 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 406/832] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:06 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:07.782160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:07.782743 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:07.789537 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:07.789977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:07.790734 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:07.791169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:07.927057 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:07.935609 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:07.937182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:07.938406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9124b8b9-0449-4752-ad5e-a7c8e10a0df6 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.160516 May 09 18:41:07.939055 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 427/833] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:07 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:08.958277 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:08.958937 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:08.969280 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:08.969747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:08.970525 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:08.970965 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:09.119468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:09.131810 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:09.133573 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:09.134804 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e3be19b0-7af9-4aa7-8b6e-40b9c412af26 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.180605 May 09 18:41:09.135391 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 407/834] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:08 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:10.156104 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:10.156728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:10.166572 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:10.167006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:10.167904 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:10.168365 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:10.307787 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:10.316094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:10.317607 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:10.318770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9251539b-8950-4ccc-ba6c-9ced31dc6c07 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.167367 May 09 18:41:10.319390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 428/835] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:10 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:11.338393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:11.339001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:11.346145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:11.346604 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:11.347389 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:11.347821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:11.484875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:11.493605 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:11.495123 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:11.496394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-950a45cc-8b38-4098-b106-f10d0220fa45 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.162337 May 09 18:41:11.496983 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 408/836] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:11 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:12.517033 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:12.517648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:12.524539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:12.525133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:12.525883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:12.526315 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:12.678573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:12.687261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:12.688842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:12.690048 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9acc54bf-fcef-4d49-8b7c-427f7b05d162 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.177307 May 09 18:41:12.690649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 429/837] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:12 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:13.709264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:13.709907 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:13.718409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:13.718848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:13.719628 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:13.720099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:13.862389 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:13.870477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:13.872003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:13.873185 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1b11418f-b69c-4c5f-99b6-1e1ed6ae97c9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.168019 May 09 18:41:13.873772 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 409/838] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:13 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:14.894575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:14.895576 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:14.903046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:14.903556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:14.904450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:14.904964 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:15.055395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:15.068359 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:15.071169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:15.073106 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5b12a5fc-7fd8-4bc9-badf-df0c6420ecb7 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1745 microversion: 2.20 time: 0.184130 May 09 18:41:15.073674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 430/839] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:14 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:16.092413 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:16.093027 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:16.099975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:16.100452 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:16.101279 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:16.101701 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:16.239623 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:16.247731 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:16.249291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:16.250479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b671bc3f-f26c-4777-98ae-01f83d9f2c59 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1745 microversion: 2.20 time: 0.162199 May 09 18:41:16.251049 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 410/840] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:16 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:17.269863 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:17.270473 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:17.277699 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:17.278150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:17.279219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:17.279648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:17.420811 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:17.433138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:17.435122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:17.436508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-99004f77-5cfa-4017-9db8-79e352458c73 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.170743 May 09 18:41:17.437067 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 431/841] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:17 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:18.456258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:18.458360 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:18.466890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:18.467713 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:18.469394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:18.470074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:18.626371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:18.635988 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:18.637516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:18.639125 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7ac4c8a7-a526-4ce0-825d-82fb84ece66e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.188056 May 09 18:41:18.645938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 411/842] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:18 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:19.658138 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:19.659562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:19.666612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:19.667327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:19.668468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:19.669094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:19.826993 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:19.835854 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:19.837245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:19.839094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fc917716-089c-47a0-8eff-534197f42ad0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.185225 May 09 18:41:19.839886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 432/843] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:19 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:20.230979 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-4830d947-a3f3-44f6-809c-6829799d62b1 req-de2bcbf5-e21d-4c7c-8223-29602aa4f7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "name": "network-vif-plugged", "status": "completed", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:20.240291 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-4830d947-a3f3-44f6-809c-6829799d62b1 req-de2bcbf5-e21d-4c7c-8223-29602aa4f7d5 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:20.241011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-4830d947-a3f3-44f6-809c-6829799d62b1 req-de2bcbf5-e21d-4c7c-8223-29602aa4f7d5 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:20.257144 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-4830d947-a3f3-44f6-809c-6829799d62b1 req-de2bcbf5-e21d-4c7c-8223-29602aa4f7d5 service nova] Creating event network-vif-plugged:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:41:20.264411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-4830d947-a3f3-44f6-809c-6829799d62b1 req-de2bcbf5-e21d-4c7c-8223-29602aa4f7d5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036893 May 09 18:41:20.265667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 412/844] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:41:20.859023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:20.860309 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:20.867509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:20.868371 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:20.869406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:20.869910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:21.026291 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:21.039942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:21.041521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:21.042770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4159eae9-1680-4b0f-9fae-ab339f637e8d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.187724 May 09 18:41:21.043346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 433/845] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:20 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:41:22.062215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:22.063190 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:22.069973 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:22.070414 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:22.071188 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:22.071614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:22.225432 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:22.234473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:22.236085 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:22.237409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0aabaf5d-1e59-4ffd-9493-efdab0c56a71 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.179502 May 09 18:41:22.244025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 413/846] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:22 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:23.258154 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:23.259619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:23.266732 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:23.267180 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:23.267979 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:23.268419 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:23.449996 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:23.464157 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:23.466010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:23.469003 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-07704c68-38e3-45d6-86a5-5738da01933e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.213110 May 09 18:41:23.484900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 434/847] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:23 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:24.493871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:24.494613 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:24.501106 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:24.501561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:24.502332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:24.502920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:24.665682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:24.675048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:24.676838 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:24.678078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0e441f17-5ff6-4ee2-a3ac-4dbbbe35e191 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.188199 May 09 18:41:24.678784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 414/848] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:24 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:25.696311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:25.696966 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:25.703406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:25.703877 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:25.704688 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:25.705124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:25.840109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:25.848336 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:25.849844 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:25.851016 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-57913e0f-831b-4f2f-93af-9db36edd5982 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1740 microversion: 2.20 time: 0.158849 May 09 18:41:25.851590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 435/849] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:25 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:26.869544 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:26.870106 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:26.877196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:26.877643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:26.878428 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:26.878861 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:27.019833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:27.028078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:27.029568 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:27.030899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-85d3894b-3b1e-4c87-9b50-1ebda1cbd67b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1722 microversion: 2.20 time: 0.165585 May 09 18:41:27.031468 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 415/850] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:26 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:28.050134 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:28.050750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:28.058051 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:28.058478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:28.059245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:28.059674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:28.199210 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:28.207423 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:28.208977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:28.210140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8b072875-9ced-4976-83a3-682cfd8b0cc8 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1722 microversion: 2.20 time: 0.164065 May 09 18:41:28.210724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 436/851] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:28 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:29.229230 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:29.229854 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:29.236700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.237199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:29.237982 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.238417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:29.367772 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:29.376117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:29.378065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:29.379226 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d233cca2-b1df-4ac7-a323-992ac3cd269e tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1725 microversion: 2.20 time: 0.154051 May 09 18:41:29.379784 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 416/852] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:29 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:29.397681 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db43bdb0-999d-41e9-ab8c-bdaeb802b274"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:29.398807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:29.405525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.405994 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:29.406776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.407208 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:29.687207 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e34cd712-40a4-4e6e-91f7-a3b0169805f2 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293534 May 09 18:41:29.687822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 437/853] 10.222.0.35 () {62 vars in 1363 bytes} [Mon May 9 18:41:29 2022] POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:41:29.802255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:29.802796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:29.809259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.809706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:29.810479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:29.810912 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:30.632526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-d735c1c8-7200-40e8-9086-b5068a9dbd7b req-598158a2-4968-4733-9918-a1b78520bafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:30.647372 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-d735c1c8-7200-40e8-9086-b5068a9dbd7b req-598158a2-4968-4733-9918-a1b78520bafe service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:30.647844 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-d735c1c8-7200-40e8-9086-b5068a9dbd7b req-598158a2-4968-4733-9918-a1b78520bafe service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:30.659923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.compute.server_external_events [req-d735c1c8-7200-40e8-9086-b5068a9dbd7b req-598158a2-4968-4733-9918-a1b78520bafe service nova] Unable to find a host for instance 6818fe6b-718d-4966-b373-d9f7e994b810. Dropping event network-vif-unplugged {{(pid=118351) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 18:41:30.660831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-d735c1c8-7200-40e8-9086-b5068a9dbd7b req-598158a2-4968-4733-9918-a1b78520bafe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032866 May 09 18:41:30.661434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 438/854] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 09 18:41:31.485416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-84e2cf60-3e57-47b8-a379-1e64890900ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments/db43bdb0-999d-41e9-ab8c-bdaeb802b274" status: 202 len: 0 microversion: 2.20 time: 1.687188 May 09 18:41:31.486530 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 417/855] 10.222.0.35 () {60 vars in 1456 bytes} [Mon May 9 18:41:29 2022] DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments/db43bdb0-999d-41e9-ab8c-bdaeb802b274 => generated 0 bytes in 1689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:41:31.543702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:31.544433 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:31.550813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:31.551259 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:31.552051 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:31.552486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:31.631585 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d3e64265-1e8b-450b-89ec-6942d3d4b660 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/action" status: 202 len: 0 microversion: 2.20 time: 0.091742 May 09 18:41:31.632290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 439/856] 10.222.0.35 () {62 vars in 1318 bytes} [Mon May 9 18:41:31 2022] POST /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:41:31.641657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:31.642644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:31.649738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:31.650329 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:31.651231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:31.651667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:31.791559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:31.800415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:31.801942 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:31.803134 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d3d9b637-8626-4f01-90ca-c2bea4cc4068 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1673 microversion: 2.20 time: 0.166523 May 09 18:41:31.803688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 418/857] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:31 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:32.822363 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:32.822958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:32.832204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:32.832658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:32.833460 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:32.833897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:32.972489 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:32.981057 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:32.982557 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:32.983895 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-5dd9dd83-45e8-4872-abf1-584bdcae257c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.165765 May 09 18:41:32.984508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 440/858] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:32 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:34.002899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:34.003523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:34.010848 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:34.011299 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:34.012625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:34.013062 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:34.210039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:34.219458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:34.225657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:34.232318 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3f9494de-b93c-4058-a76b-c893416dcc5a tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.233257 May 09 18:41:34.234261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 419/859] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:33 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:35.252026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:35.252736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:35.259302 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:35.260043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:35.261021 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:35.261616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:35.422292 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:35.431589 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:35.433508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:35.435198 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-06158a93-e657-41a0-9be9-d4cb267b2b46 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.186867 May 09 18:41:35.435363 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 441/860] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:35 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:35.556884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-592240503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006085322", "security_groups": [{"name": "tempest-secgroup-smoke-1009084773"}], "block_device_mapping_v2": [{"uuid": "7ee64020-1373-49ae-ab7e-428a6080954a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9626c38-13d9-423a-9810-cc67a8569feb"}]}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:35.694443 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] validate_networks() for [('b9626c38-13d9-423a-9810-cc67a8569feb', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:41:36.177661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:41:36.178084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:41:36.178833 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:41:36.179592 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:41:36.180213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:41:36.190746 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:36.191196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:36.192229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:36.192674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:36.209821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:41:36.213885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Getting quotas for user 86609452d1a44c9d953ed642936003f1 and project 9292fda06d234de8b60b0131b87bbf46. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:41:36.281093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:41:36.283433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ee64020-1373-49ae-ab7e-428a6080954a',volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:41:36.428778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1873acc3-5155-4071-a4f3-c68f983a8287 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875582 May 09 18:41:36.429663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 420/861] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:41:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:41:36.454432 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c6188198-a206-4e7e-9f48-bb9a0dbb5aa1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:36.455174 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:36.455862 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:36.456367 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c6188198-a206-4e7e-9f48-bb9a0dbb5aa1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:36.463178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:36.464053 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:36.465006 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:36.465445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:36.536063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c6188198-a206-4e7e-9f48-bb9a0dbb5aa1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:36.543868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c6188198-a206-4e7e-9f48-bb9a0dbb5aa1 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1094 microversion: 2.1 time: 0.107567 May 09 18:41:36.544504 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 442/862] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:36 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:36.670815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:36.683759 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:36.686003 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:36.688247 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a6394455-e92a-4aa2-95e2-e1b703d04981 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.237244 May 09 18:41:36.700410 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 421/863] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:36 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:37.562673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:37.564445 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:37.573172 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:37.573987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:37.574933 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:37.575418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:37.636605 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:37.644821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-24cb8152-2dbf-40ad-9461-d354e19cc259 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1144 microversion: 2.1 time: 0.086776 May 09 18:41:37.648783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 443/864] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:37 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:37.707246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:37.707847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:37.714796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:37.715525 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:37.716527 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:37.717160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:37.886796 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:37.897835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:37.899645 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:37.901069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e87511c0-a90f-4063-a682-6e0a11020375 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.197813 May 09 18:41:37.901642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 422/865] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:37 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:38.663788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:38.664495 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:38.671232 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:38.671676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:38.672556 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:38.672984 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:38.741533 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:38.755068 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1f99f007-85cb-40db-83a4-d2ca38db6b16 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1144 microversion: 2.1 time: 0.095625 May 09 18:41:38.755675 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 444/866] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:38 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:38.921580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:38.922210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:38.932364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:38.932943 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:38.933969 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:38.934405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:39.081089 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:39.089371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:39.090882 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:39.092463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2f472a0d-b7e6-4622-b386-f9992d46eb76 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.175565 May 09 18:41:39.093422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 423/867] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:38 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:39.844511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:39.845279 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:39.852091 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:39.852680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:39.853624 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:39.854110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:39.937940 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:39.949435 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0fd9dfd1-cd2f-4ba1-8273-5d853b2f8865 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1144 microversion: 2.1 time: 0.179343 May 09 18:41:39.951422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 445/868] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:39 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1144 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:40.111049 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:40.111661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:40.118789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:40.119233 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:40.120052 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:40.120476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:40.442139 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:40.450909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:40.452508 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:40.453712 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e3228ff5-bdfc-4c63-827b-82890c51df30 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.346833 May 09 18:41:40.454292 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 424/869] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:40 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:40.969806 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:40.970611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:40.979090 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:40.979745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:40.980578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:40.981006 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:41.066711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:41.080311 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7eba0ff4-5508-4ad4-8e34-92450d06b2fa tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1144 microversion: 2.1 time: 0.115705 May 09 18:41:41.089426 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 446/870] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:40 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:41.473519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:41.474284 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:41.483050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:41.483822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:41.484878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:41.485539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:41.625711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:41.634364 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:41.636393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:41.638201 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f3e4b0ec-ffe5-4cac-a8c0-96428cfaad47 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.168777 May 09 18:41:41.639459 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 425/871] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:41 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:42.103262 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:42.103893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:42.112059 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:42.112673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:42.113454 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:42.113995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:42.192234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:42.203182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f026fa0e-d693-41d6-a54f-b923e66fd0f5 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1144 microversion: 2.1 time: 0.103651 May 09 18:41:42.212168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 447/872] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:42 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:42.657626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:42.658244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:42.665044 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:42.665497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:42.666264 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:42.666685 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:42.795211 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:42.803109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:42.804667 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:42.805829 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e2f65cf5-65b5-47b8-9c39-e2acaa2ec502 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.152432 May 09 18:41:42.806395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 426/873] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:42 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:43.220629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:43.221246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:43.228147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:43.228594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:43.229377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:43.229834 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:43.381390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:43.390364 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-434abd92-3f27-4cf7-ba97-16c4ec31743c tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1192 microversion: 2.1 time: 0.173681 May 09 18:41:43.394066 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 448/874] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:43 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1192 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:43.825493 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:43.826116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:43.833089 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:43.833539 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:43.834354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:43.834781 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:43.969337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:43.977433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:43.979018 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:43.980393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ac6bc344-127c-44f3-b6bb-eb3235d77510 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.159663 May 09 18:41:43.981135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 427/875] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:43 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:44.415023 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:44.415652 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:44.422195 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:44.422651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:44.423429 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:44.423867 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:44.565463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:44.573327 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9533d006-1bdf-4759-a0bc-9edf867dd924 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.162202 May 09 18:41:44.573917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 449/876] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:44 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:44.999738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:45.000464 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:45.007160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:45.007686 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:45.008581 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:45.009126 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:45.066722 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-eedbf27e-abf8-450d-a23c-393759133c65 req-65b1e7ea-caf2-4260-848f-c43460457371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7235618-54d8-4976-9161-8bb1890691d7", "tag": "05f9759d-6140-486a-bda9-39dc0271d96b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:45.091562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-eedbf27e-abf8-450d-a23c-393759133c65 req-65b1e7ea-caf2-4260-848f-c43460457371 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:45.092044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-eedbf27e-abf8-450d-a23c-393759133c65 req-65b1e7ea-caf2-4260-848f-c43460457371 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:45.110752 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-eedbf27e-abf8-450d-a23c-393759133c65 req-65b1e7ea-caf2-4260-848f-c43460457371 service nova] Creating event network-changed:05f9759d-6140-486a-bda9-39dc0271d96b for instance f7235618-54d8-4976-9161-8bb1890691d7 on hv-cinder-83588 May 09 18:41:45.116677 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-eedbf27e-abf8-450d-a23c-393759133c65 req-65b1e7ea-caf2-4260-848f-c43460457371 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058714 May 09 18:41:45.118075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 450/877] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:41:45.178461 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:45.187513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:45.189688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:45.190908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f084c448-79ec-48b3-b890-408893d6365d tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.195660 May 09 18:41:45.192090 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 428/878] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:44 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:45.594674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:45.595263 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:45.602725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:45.603179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:45.603984 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:45.604428 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:45.741682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:45.749821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-868fea8a-4af0-49f4-8064-65627c07075f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.161269 May 09 18:41:45.750422 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 451/879] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:45 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:46.209839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:46.210477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:46.217356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:46.217773 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:46.218844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:46.219482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:46.381416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:46.390904 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:46.392476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:46.393662 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7fdd4034-827f-4c62-90fb-dafd800d59ac tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.187853 May 09 18:41:46.394227 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 429/880] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:46 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:46.770683 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:46.771543 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:46.781132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:46.781577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:46.782358 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:46.783019 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:46.919629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:46.927900 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-948a0991-7f99-4013-99c1-7be034ad8869 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.164187 May 09 18:41:46.928534 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 452/881] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:46 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:47.416627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:47.417572 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:47.428469 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:47.429240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:47.430473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:47.431243 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:47.564723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:47.572726 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:47.574215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:47.575381 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-030a909e-a974-4b1e-9a3e-4847684d60b4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.165534 May 09 18:41:47.575938 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 430/882] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:47 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:47.945194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:47.945838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:47.952571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:47.953015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:47.953781 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:47.954209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:48.101290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:48.109455 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-69844126-b176-43ac-9045-16983d1adc17 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.168232 May 09 18:41:48.110032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 453/883] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:47 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:48.364817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-94306382-4af8-4811-8331-9b0b913ee70f req-1debf96e-3a5d-42e5-8ad9-35213de33264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "name": "network-vif-plugged", "status": "completed", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:48.374097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-94306382-4af8-4811-8331-9b0b913ee70f req-1debf96e-3a5d-42e5-8ad9-35213de33264 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:48.374502 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-94306382-4af8-4811-8331-9b0b913ee70f req-1debf96e-3a5d-42e5-8ad9-35213de33264 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:48.387273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-94306382-4af8-4811-8331-9b0b913ee70f req-1debf96e-3a5d-42e5-8ad9-35213de33264 service nova] Creating event network-vif-plugged:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:41:48.392647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-94306382-4af8-4811-8331-9b0b913ee70f req-1debf96e-3a5d-42e5-8ad9-35213de33264 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 May 09 18:41:48.393483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 431/884] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:41:48.594593 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:48.595186 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:48.601539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:48.601969 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:48.602737 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:48.603170 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:48.737194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:48.745374 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:48.746893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:48.748108 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-031ea2b2-e8e9-42fa-8a1b-70ac32886cf0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.157645 May 09 18:41:48.748779 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 454/885] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:48 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:49.127170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:49.127845 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:49.135074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:49.135524 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:49.136348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:49.137140 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:49.283871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:49.293787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c64c8b33-0070-44ef-95f1-39359e0fa84f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.170624 May 09 18:41:49.294654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 432/886] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:49 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:49.767578 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:49.768197 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:49.775261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:49.775731 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:49.776554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:49.776988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:49.925131 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:49.934411 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:49.936178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:49.937450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bd2d0da0-1cc8-4a02-b08e-c3a52063f5fb tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1731 microversion: 2.20 time: 0.174042 May 09 18:41:49.937981 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 455/887] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:49 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:50.315932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:50.316580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:50.324128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:50.324579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:50.325358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:50.325788 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:50.466421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:50.475048 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-87e6c830-7ef5-4e39-8f85-e3681cbb8254 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.162990 May 09 18:41:50.475704 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 433/888] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:50 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:50.965494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:50.966058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:50.978505 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:50.978969 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:50.979864 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:50.980447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:51.112526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:51.120827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:51.122239 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:51.123395 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-08d0ae39-720b-4159-a4f2-7a1e0663463c tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1718 microversion: 2.20 time: 0.162107 May 09 18:41:51.124045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 456/889] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:41:50 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:41:51.493026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:51.493647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:51.500600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:51.501064 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:51.501847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:51.502287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:51.639533 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:51.647747 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c3bf2e5b-d9e6-4e09-ae41-7611eebb8f40 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.158690 May 09 18:41:51.648356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 434/890] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:51 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:52.665559 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:52.666329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:52.673120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:52.673555 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:52.674350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:52.674770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:52.811351 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:52.822581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-98d5e4f8-38e2-47d6-b6c1-b899fa55a549 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.160628 May 09 18:41:52.823382 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 457/891] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:52 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:53.842388 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:53.842976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:53.849683 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:53.850135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:53.850907 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:53.851653 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:53.986205 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:53.994408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8446862f-97b8-428e-9148-2f394f278309 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.156148 May 09 18:41:53.995281 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 435/892] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:53 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:55.015194 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:55.015828 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:55.022581 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:55.023027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:55.023792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:55.024260 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:55.157063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:55.165711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1db3481b-786c-40f0-88de-e79bee223542 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.154921 May 09 18:41:55.166296 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 458/893] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:55 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:56.183700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:56.184292 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:56.191456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:56.191914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:56.192732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:56.193169 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:56.323552 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:56.331056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-290e84c1-84b5-4ea7-8b65-94db89697e95 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.151395 May 09 18:41:56.331627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 436/894] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:56 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:56.405571 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-842b00c6-2491-4052-9f7e-a3aead1de8f4 req-e1ac112e-1a20-40bf-b407-b6c3eff83c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7235618-54d8-4976-9161-8bb1890691d7", "name": "network-vif-plugged", "status": "completed", "tag": "05f9759d-6140-486a-bda9-39dc0271d96b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:56.414702 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-842b00c6-2491-4052-9f7e-a3aead1de8f4 req-e1ac112e-1a20-40bf-b407-b6c3eff83c26 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:56.415151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-842b00c6-2491-4052-9f7e-a3aead1de8f4 req-e1ac112e-1a20-40bf-b407-b6c3eff83c26 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:56.426736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-842b00c6-2491-4052-9f7e-a3aead1de8f4 req-e1ac112e-1a20-40bf-b407-b6c3eff83c26 service nova] Creating event network-vif-plugged:05f9759d-6140-486a-bda9-39dc0271d96b for instance f7235618-54d8-4976-9161-8bb1890691d7 on hv-cinder-83588 May 09 18:41:56.431980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-842b00c6-2491-4052-9f7e-a3aead1de8f4 req-e1ac112e-1a20-40bf-b407-b6c3eff83c26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 May 09 18:41:56.432629 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 459/895] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:41:57.348598 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:57.349224 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:57.355982 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:57.356451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:57.357219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:57.357654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:57.493871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:57.501520 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-629340e7-6f71-4d29-8320-893ab5ce35d9 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1266 microversion: 2.1 time: 0.156996 May 09 18:41:57.502050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 437/896] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:57 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:58.519689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:58.520503 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:58.527247 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:58.527689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:58.528619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:58.529044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:58.666478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:58.674265 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bd5e5223-7c81-4451-aa11-6204771f64ef tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1454 microversion: 2.1 time: 0.159363 May 09 18:41:58.674830 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 460/897] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:58 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:58.690577 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:58.691193 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:58.697966 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:58.698412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:58.699186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:58.699617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:58.827979 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:58.836040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8be27ddd-fe86-48a2-a6c3-1b6d6451028b tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1454 microversion: 2.1 time: 0.149322 May 09 18:41:58.836624 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 438/898] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:41:58 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:00.799407 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-f17eaf86-bcd6-4f4d-96c1-0ecbdf396943 req-761a7d21-354d-491c-ae5b-027385e8217a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7235618-54d8-4976-9161-8bb1890691d7", "tag": "05f9759d-6140-486a-bda9-39dc0271d96b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:00.808221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f17eaf86-bcd6-4f4d-96c1-0ecbdf396943 req-761a7d21-354d-491c-ae5b-027385e8217a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:00.808664 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-f17eaf86-bcd6-4f4d-96c1-0ecbdf396943 req-761a7d21-354d-491c-ae5b-027385e8217a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:00.820109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-f17eaf86-bcd6-4f4d-96c1-0ecbdf396943 req-761a7d21-354d-491c-ae5b-027385e8217a service nova] Creating event network-changed:05f9759d-6140-486a-bda9-39dc0271d96b for instance f7235618-54d8-4976-9161-8bb1890691d7 on hv-cinder-83588 May 09 18:42:00.825245 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-f17eaf86-bcd6-4f4d-96c1-0ecbdf396943 req-761a7d21-354d-491c-ae5b-027385e8217a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029905 May 09 18:42:00.825910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 461/899] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:24.600895 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:24.602041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:24.608381 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.608847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.609627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.610070 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.640409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6c8229e9-54b7-4e0e-aad3-8d2ea447f77b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044009 May 09 18:42:24.640914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 439/900] 10.222.0.35 () {60 vars in 1342 bytes} [Mon May 9 18:42:24 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:24.698819 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:24.699408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:24.706073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.706521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.707297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.707736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.735054 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:42:24.825353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d843909e-a0a6-426c-959f-ae61c95cf9b0 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 204 len: 0 microversion: 2.20 time: 0.130682 May 09 18:42:24.826480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 462/901] 10.222.0.35 () {60 vars in 1279 bytes} [Mon May 9 18:42:24 2022] DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 18:42:24.838940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:24.839719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:24.846708 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.847244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.848104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.848611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.991351 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:25.000456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:25.002177 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:25.003469 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fcb474d1-11b3-40cf-9616-587a495b7aa9 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.171771 May 09 18:42:25.004234 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 440/902] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:24 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:42:26.025143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:26.025836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:26.033669 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.034107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.034893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.035324 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.182533 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:26.191932 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:26.193628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:26.194801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-25623383-8fe5-4a04-b6f3-b8741982c381 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1724 microversion: 2.20 time: 0.174135 May 09 18:42:26.195409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 463/903] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:26 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:42:27.215058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:27.215765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:27.223062 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:27.223436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:27.224454 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:27.225047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:27.267687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-23cb693e-503d-449c-be29-4c072f961d3c req-4b381499-c1d9-4029-94e6-7df0a1732bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6818fe6b-718d-4966-b373-d9f7e994b810", "name": "network-vif-deleted", "tag": "2d2145c0-22e9-4ed5-b931-46ba23e10bb1"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:27.281056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-23cb693e-503d-449c-be29-4c072f961d3c req-4b381499-c1d9-4029-94e6-7df0a1732bfb service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:27.281477 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-23cb693e-503d-449c-be29-4c072f961d3c req-4b381499-c1d9-4029-94e6-7df0a1732bfb service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:27.301454 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:27.310870 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:27.314235 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890667c36f9646b1a9fcc907f28b4b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149f6b903b8f4fb688927a1234efa295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:27.315785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-32c574c3-4c27-419f-b5c0-b5fe111f2e8b tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 200 len: 1366 microversion: 2.20 time: 0.105770 May 09 18:42:27.317212 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-23cb693e-503d-449c-be29-4c072f961d3c req-4b381499-c1d9-4029-94e6-7df0a1732bfb service nova] Creating event network-vif-deleted:2d2145c0-22e9-4ed5-b931-46ba23e10bb1 for instance 6818fe6b-718d-4966-b373-d9f7e994b810 on hv-cinder-83588 May 09 18:42:27.327093 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 464/904] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:27 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:42:27.331748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-23cb693e-503d-449c-be29-4c072f961d3c req-4b381499-c1d9-4029-94e6-7df0a1732bfb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169940 May 09 18:42:27.334289 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 441/905] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:28.334891 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:28.335508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:28.342356 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:28.342799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:28.343636 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:28.344104 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:28.358052 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 HTTP/1.1 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:42:28.359799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:28.361912 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '6818fe6b-718d-4966-b373-d9f7e994b810'} May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:42:28.362838 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:28.364450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:28.365878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:42:28.365878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0a90dc21-533f-49f5-b087-2ca51a72a18f tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 404 len: 111 microversion: 2.20 time: 0.030460 May 09 18:42:28.365878 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 465/906] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:28 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:42:28.375497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-930d77e5-3cfb-415d-97f6-3f3610231284 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '.version_select at 0x7fe8ba9c4280>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:28.396457 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-930d77e5-3cfb-415d-97f6-3f3610231284 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046420334" status: 204 len: 0 microversion: 2.20 time: 0.027727 May 09 18:42:28.397068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 442/907] 10.222.0.35 () {60 vars in 1261 bytes} [Mon May 9 18:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046420334 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:42:30.516326 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:30.516958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:30.523682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:30.524216 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:30.525033 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:30.525480 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:30.540729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 HTTP/1.1 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:42:30.542400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.544209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '6818fe6b-718d-4966-b373-d9f7e994b810'} May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:42:30.545056 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.546597 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:30.548178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:42:30.548178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d4f27f2d-f1ca-467a-a91b-76b03d9d1a24 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 404 len: 111 microversion: 2.20 time: 0.032662 May 09 18:42:30.548178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 466/908] 10.222.0.35 () {60 vars in 1279 bytes} [Mon May 9 18:42:30 2022] DELETE /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:42:30.554175 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:30.554984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 6818fe6b-718d-4966-b373-d9f7e994b810] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:30.562791 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:30.563307 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:30.564130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:30.564569 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:30.579244 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 HTTP/1.1 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:42:30.581395 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.585911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '6818fe6b-718d-4966-b373-d9f7e994b810'} May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:42:30.587684 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. May 09 18:42:30.589626 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:30.592435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 6818fe6b-718d-4966-b373-d9f7e994b810 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:42:30.592435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-97fd80a2-ff74-4fea-8c05-9509a24c0153 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810" status: 404 len: 111 microversion: 2.20 time: 0.033225 May 09 18:42:30.592435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 443/909] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:30 2022] GET /compute/v2.1/servers/6818fe6b-718d-4966-b373-d9f7e994b810 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:42:31.748045 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:31.748642 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:31.755416 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:31.755859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:31.756657 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:31.757083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:31.771662 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa HTTP/1.1 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:42:31.773267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.774720 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '71604286-8561-4482-bfb1-02330ae4b1fa'} May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:42:31.775488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.776729 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:42:31.778179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:42:31.778179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0062461f-c45e-45c7-a08e-961d0aef76da tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 404 len: 111 microversion: 2.20 time: 0.030801 May 09 18:42:31.778179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 467/910] 10.222.0.35 () {60 vars in 1279 bytes} [Mon May 9 18:42:31 2022] DELETE /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:42:31.786876 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:31.787884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] [instance: 71604286-8561-4482-bfb1-02330ae4b1fa] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:31.802305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:31.802763 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:31.803599 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:31.804077 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:31.819733 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] HTTP exception thrown: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Request method failure captured: May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa HTTP/1.1 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV9au3O_Ml6j6Kl8s-rgxccKDkAQiNCiyFL9nqKcJalDuZzY4uD0XNZkZrg6fpHbf1hi95pvfRAn7otMKG5Q-mFWtKbMXRJYAwUV1h70F8zO__Uyy0-0hbqwIAyQmGyGNmfgeVyZNwht-Twf3GUGGElNUlrkPMQT2u3yxJ7pQSquAX4 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:42:31.821424 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/149f6b903b8f4fb688927a1234efa295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_149f6b903b8f4fb688927a1234efa295"}]}] May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 149f6b903b8f4fb688927a1234efa295 May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185263097 May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 890667c36f9646b1a9fcc907f28b4b1b May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185263097-project May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.823075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '71604286-8561-4482-bfb1-02330ae4b1fa'} May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:42:31.823932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. May 09 18:42:31.825162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:42:31.826220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] Returning 404 to user: Instance 71604286-8561-4482-bfb1-02330ae4b1fa could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:42:31.826220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8ea4485d-bee5-4f8a-a509-e1df24e8acb4 tempest-AttachVolumeShelveTestJSON-1185263097 tempest-AttachVolumeShelveTestJSON-1185263097-project] 10.222.0.35 "GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa" status: 404 len: 111 microversion: 2.20 time: 0.042174 May 09 18:42:31.826220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 444/911] 10.222.0.35 () {60 vars in 1276 bytes} [Mon May 9 18:42:31 2022] GET /compute/v2.1/servers/71604286-8561-4482-bfb1-02330ae4b1fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:42:41.168391 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-348c1f40-6e82-4cd1-bdcc-02204e44ab4e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: .version_select at 0x7fe8c3db60d0>, body: {"keypair": {"name": "tempest-keypair-975661816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJfMuNoyFWARIPW0VmcqtxJS0oLg8FFbnOAkah8bP0FywPKkFZe94ntAx3BpWp/7ZJmucRunG5a2BH0onKebVEUUTulALbKH38HXKT/Yk6fi52r11XWkQBA5JPpkZ3L3w=="}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:41.182954 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-348c1f40-6e82-4cd1-bdcc-02204e44ab4e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:42:41.186883 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-348c1f40-6e82-4cd1-bdcc-02204e44ab4e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for user b50fae7cb7f645d7ade69c2e9135f8f0 and project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:42:41.210952 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-348c1f40-6e82-4cd1-bdcc-02204e44ab4e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168897 May 09 18:42:41.211630 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 468/912] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:42:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:42.926591 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1986338361", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b55eb03-22f4-4dc1-9347-3cca06936c12"}], "security_groups": [{"name": "tempest-securitygroup--1814991485"}], "key_name": "tempest-keypair-975661816", "user_data": "}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:43.045886 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] validate_networks() for [('4b55eb03-22f4-4dc1-9347-3cca06936c12', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:42:43.656871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:42:43.657560 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:42:43.658220 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:42:43.658775 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:42:43.659654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:42:43.671139 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:43.671651 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:43.677964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:43.677964 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:43.693358 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:42:43.697916 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for user b50fae7cb7f645d7ade69c2e9135f8f0 and project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:42:43.710347 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:42:43.713060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:42:43.766258 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b8515cf5-0270-417d-9798-cc8faaba00bf tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846992 May 09 18:42:43.767642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 445/913] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:42:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:42:43.777498 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-65a7ad70-0a93-4eda-adfc-3537a351b734 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:43.778821 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-65a7ad70-0a93-4eda-adfc-3537a351b734 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:43.876300 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-65a7ad70-0a93-4eda-adfc-3537a351b734 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:43.884346 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-65a7ad70-0a93-4eda-adfc-3537a351b734 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1237 microversion: 2.1 time: 0.110680 May 09 18:42:43.895672 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 469/914] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:43 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:44.903442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:44.904077 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:44.911614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:44.912143 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:44.912937 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:44.913377 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:44.984838 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:44.992532 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-30c95386-e9e5-453c-8bbe-4931b6c5644b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1289 microversion: 2.1 time: 0.093481 May 09 18:42:44.993758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 446/915] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:44 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:46.012529 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:46.013323 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:46.020486 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:46.021064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:46.023542 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:46.024099 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:46.186203 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:46.194697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8dfc4d3f-5628-41b1-96dd-c6fa21a732c3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.187069 May 09 18:42:46.195601 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 470/916] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:46 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:46.625409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-5738d4cc-d641-40bd-bba7-92faac3236e4 req-798bd285-a9e8-4de6-94ec-887239fb25a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0987980-b2da-4bb2-a241-0b913e917826", "tag": "ce24fd0d-26e0-47af-afb6-fe20e0c212a4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:46.637625 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-5738d4cc-d641-40bd-bba7-92faac3236e4 req-798bd285-a9e8-4de6-94ec-887239fb25a0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:46.638173 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-5738d4cc-d641-40bd-bba7-92faac3236e4 req-798bd285-a9e8-4de6-94ec-887239fb25a0 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:46.652343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-5738d4cc-d641-40bd-bba7-92faac3236e4 req-798bd285-a9e8-4de6-94ec-887239fb25a0 service nova] Creating event network-changed:ce24fd0d-26e0-47af-afb6-fe20e0c212a4 for instance b0987980-b2da-4bb2-a241-0b913e917826 on hv-cinder-83588 May 09 18:42:46.659465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-5738d4cc-d641-40bd-bba7-92faac3236e4 req-798bd285-a9e8-4de6-94ec-887239fb25a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 May 09 18:42:46.660793 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 447/917] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:47.217440 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:47.218072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:47.225620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:47.226074 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:47.226923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:47.227333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:47.365785 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:47.374305 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-41910a36-2b71-49a1-bd5b-2e06c0dca09f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.160940 May 09 18:42:47.375421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 471/918] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:47 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:48.393434 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:48.394131 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:48.400896 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:48.401345 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:48.402125 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:48.402556 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:48.549372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:48.557640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-274c5636-196f-47e5-a909-49cfc2ccb3e5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.169322 May 09 18:42:48.558240 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 448/919] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:48 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:49.576370 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:49.577018 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:49.583965 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:49.584412 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:49.585243 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:49.585684 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:49.732494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:49.741148 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1a4ec219-0e9d-43dc-b35b-50a032efdc48 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.168848 May 09 18:42:49.741651 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 472/920] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:49 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:50.759624 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:50.760580 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:50.767566 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:50.768040 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:50.768817 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:50.769253 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:50.930890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:50.939729 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-50f47f45-0ee5-44a2-8069-ca659b9feae0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.183986 May 09 18:42:50.940465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 449/921] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:50 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:42:51.959393 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:51.960123 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:51.967511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:51.967511 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:51.968193 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:51.968626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:52.134248 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:52.145254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-de212765-fb3a-4d51-8478-03f477e2e230 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.190698 May 09 18:42:52.145858 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 473/922] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:51 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:52.821879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-e06f8a50-a188-4e01-92bd-36a5c6137950 req-e59ed5ec-ed48-4e1c-a0d8-729da96fb779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0987980-b2da-4bb2-a241-0b913e917826", "name": "network-vif-plugged", "status": "completed", "tag": "ce24fd0d-26e0-47af-afb6-fe20e0c212a4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:52.831101 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e06f8a50-a188-4e01-92bd-36a5c6137950 req-e59ed5ec-ed48-4e1c-a0d8-729da96fb779 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:52.831553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e06f8a50-a188-4e01-92bd-36a5c6137950 req-e59ed5ec-ed48-4e1c-a0d8-729da96fb779 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:52.843934 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-e06f8a50-a188-4e01-92bd-36a5c6137950 req-e59ed5ec-ed48-4e1c-a0d8-729da96fb779 service nova] Creating event network-vif-plugged:ce24fd0d-26e0-47af-afb6-fe20e0c212a4 for instance b0987980-b2da-4bb2-a241-0b913e917826 on hv-cinder-83588 May 09 18:42:52.849906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-e06f8a50-a188-4e01-92bd-36a5c6137950 req-e59ed5ec-ed48-4e1c-a0d8-729da96fb779 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108266 May 09 18:42:52.850601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 450/923] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:53.163530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:53.164215 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:53.173539 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:53.173989 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:53.174767 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:53.175202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:53.320942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:53.330043 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c2219bd2-588a-4807-922c-088872b04960 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1363 microversion: 2.1 time: 0.170525 May 09 18:42:53.330664 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 474/924] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:53 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:54.348541 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:54.349242 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:54.356238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:54.356689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:54.357483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:54.357908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:54.502097 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:54.511661 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f8b1ac0a-12af-4a3e-a8bf-0b8b728cad6e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1549 microversion: 2.1 time: 0.167980 May 09 18:42:54.512289 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 451/925] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:42:54 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:54.528287 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:54.528892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:54.535788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:54.536267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:54.537107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:54.537476 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:54.623417 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-576e6e09-e4d1-4b63-bd38-28887e240c1d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099011 May 09 18:42:54.624040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 475/926] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:42:54 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:55.743382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-de9ea10d-7a2b-46bd-98c0-728be7d2b4f6 req-40faec11-fa6c-4686-ac7e-b0f4b635a08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0987980-b2da-4bb2-a241-0b913e917826", "tag": "ce24fd0d-26e0-47af-afb6-fe20e0c212a4"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:55.757542 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-de9ea10d-7a2b-46bd-98c0-728be7d2b4f6 req-40faec11-fa6c-4686-ac7e-b0f4b635a08d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:55.757989 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-de9ea10d-7a2b-46bd-98c0-728be7d2b4f6 req-40faec11-fa6c-4686-ac7e-b0f4b635a08d service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:55.770050 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-de9ea10d-7a2b-46bd-98c0-728be7d2b4f6 req-40faec11-fa6c-4686-ac7e-b0f4b635a08d service nova] Creating event network-changed:ce24fd0d-26e0-47af-afb6-fe20e0c212a4 for instance b0987980-b2da-4bb2-a241-0b913e917826 on hv-cinder-83588 May 09 18:42:55.775356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-de9ea10d-7a2b-46bd-98c0-728be7d2b4f6 req-40faec11-fa6c-4686-ac7e-b0f4b635a08d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092394 May 09 18:42:55.776270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 452/927] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:30.835206 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-a3b709e3-8931-424c-9e95-d27b7d4a9563 req-37cd7321-f531-4894-84af-7200dfb79d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7235618-54d8-4976-9161-8bb1890691d7", "tag": "05f9759d-6140-486a-bda9-39dc0271d96b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:30.839924 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:30.841338 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:30.843689 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a3b709e3-8931-424c-9e95-d27b7d4a9563 req-37cd7321-f531-4894-84af-7200dfb79d27 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:30.844167 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a3b709e3-8931-424c-9e95-d27b7d4a9563 req-37cd7321-f531-4894-84af-7200dfb79d27 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:30.848246 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:30.848700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:30.849531 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:30.849967 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:30.856299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-a3b709e3-8931-424c-9e95-d27b7d4a9563 req-37cd7321-f531-4894-84af-7200dfb79d27 service nova] Creating event network-changed:05f9759d-6140-486a-bda9-39dc0271d96b for instance f7235618-54d8-4976-9161-8bb1890691d7 on hv-cinder-83588 May 09 18:43:30.861733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-a3b709e3-8931-424c-9e95-d27b7d4a9563 req-37cd7321-f531-4894-84af-7200dfb79d27 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030992 May 09 18:43:30.862418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 476/928] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:30.878319 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:43:30.975350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4680ff20-35df-4755-9c5b-c150f9d7e016 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 204 len: 0 microversion: 2.1 time: 0.140255 May 09 18:43:30.975987 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 453/929] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:43:30 2022] DELETE /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:43:30.984956 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:30.985682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:30.992690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:30.993141 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:30.994561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:30.995048 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:31.150554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:31.158451 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-21510376-f763-4998-9eab-196b13ccd6bb tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1579 microversion: 2.1 time: 0.177783 May 09 18:43:31.159122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 477/930] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:30 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:43:31.547689 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:31.548316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:31.554572 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:31.555023 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:31.555789 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:31.556249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:31.582562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-813fdd15-6f28-45e5-8be0-f1cdaff61c26 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/ips" status: 200 len: 145 microversion: 2.1 time: 0.039267 May 09 18:43:31.583316 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 454/931] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:43:31 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:32.177552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:32.178136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:32.186670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:32.187229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:32.188234 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:32.188669 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:32.342114 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:32.350815 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-37264f79-62e5-442a-a447-c9e95c4eca46 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1579 microversion: 2.1 time: 0.177139 May 09 18:43:32.351514 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 478/932] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:32 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:43:33.369112 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:33.369723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:33.376712 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:33.377164 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:33.378130 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:33.378562 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:33.531980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:33.540682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-754733c9-74c9-4cca-9147-37cda75593e8 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 200 len: 1460 microversion: 2.1 time: 0.175429 May 09 18:43:33.542192 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 455/933] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:33 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 1460 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:33.574380 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-81682a56-4660-466f-b23f-108470a504a8 req-b0e114a9-4f2f-4883-b601-e81862c00553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7235618-54d8-4976-9161-8bb1890691d7", "name": "network-vif-deleted", "tag": "05f9759d-6140-486a-bda9-39dc0271d96b"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:33.583704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-81682a56-4660-466f-b23f-108470a504a8 req-b0e114a9-4f2f-4883-b601-e81862c00553 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:33.584270 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-81682a56-4660-466f-b23f-108470a504a8 req-b0e114a9-4f2f-4883-b601-e81862c00553 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:33.596394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-81682a56-4660-466f-b23f-108470a504a8 req-b0e114a9-4f2f-4883-b601-e81862c00553 service nova] Creating event network-vif-deleted:05f9759d-6140-486a-bda9-39dc0271d96b for instance f7235618-54d8-4976-9161-8bb1890691d7 on hv-cinder-83588 May 09 18:43:33.602038 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-81682a56-4660-466f-b23f-108470a504a8 req-b0e114a9-4f2f-4883-b601-e81862c00553 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031338 May 09 18:43:33.602674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 479/934] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:34.097002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7913eab6-2c5a-4fda-9387-8694c1e00027"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:34.098608 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:34.104986 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:34.105385 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:34.106160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:34.106622 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:34.377976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fdf7e58c-d035-400e-b9d3-591f0d323c8b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285630 May 09 18:43:34.378732 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 456/935] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:43:34 2022] POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:34.563026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:34.564035 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: f7235618-54d8-4976-9161-8bb1890691d7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:34.573673 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:34.574209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:34.575314 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:34.575910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:34.592124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] HTTP exception thrown: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Request method failure captured: May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 HTTP/1.1 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV8xxoRTaa-aFmqstUUkR1fjLHOkLMe-5MesavmvB6F3tJNSIKkYb2e_0aBpJij7DXz-Z8Gq_84mAcn2Cci8rlsbTd3JpUAMcL8HlzjngHoJm4qwwCcDdPy-qiM8aDxEl5SbKgFXMZqcWhUQTch9mF13h0GrZzqz7KZDxWiK5fkIbyY May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:43:34.593768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9292fda06d234de8b60b0131b87bbf46"}]}] May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 86609452d1a44c9d953ed642936003f1 May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. May 09 18:43:34.595521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'f7235618-54d8-4976-9161-8bb1890691d7'} May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:43:34.596660 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. May 09 18:43:34.598219 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:34.599697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Returning 404 to user: Instance f7235618-54d8-4976-9161-8bb1890691d7 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:43:34.599697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4b55a68f-37b9-4b9a-8a41-fc2ff9aae38e tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7" status: 404 len: 111 microversion: 2.1 time: 0.038281 May 09 18:43:34.599697 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 480/936] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:34 2022] GET /compute/v2.1/servers/f7235618-54d8-4976-9161-8bb1890691d7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:43:37.743500 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:37.744112 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:37.745615 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-7d5755fd-9f9b-4637-a3f4-a7e30c1377f9 req-038d841a-5164-4bfa-86f6-7013276e59a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c381236c-6ccf-420b-be56-4f499d767474", "tag": "ac0bd851-ca4d-4d0c-8d7b-b047915f11f1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:37.750635 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:37.751088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:37.751877 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:37.752381 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:37.755425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-7d5755fd-9f9b-4637-a3f4-a7e30c1377f9 req-038d841a-5164-4bfa-86f6-7013276e59a9 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:37.756092 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-7d5755fd-9f9b-4637-a3f4-a7e30c1377f9 req-038d841a-5164-4bfa-86f6-7013276e59a9 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:37.768694 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-7d5755fd-9f9b-4637-a3f4-a7e30c1377f9 req-038d841a-5164-4bfa-86f6-7013276e59a9 service nova] Creating event network-changed:ac0bd851-ca4d-4d0c-8d7b-b047915f11f1 for instance c381236c-6ccf-420b-be56-4f499d767474 on hv-cinder-83588 May 09 18:43:37.774093 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-7d5755fd-9f9b-4637-a3f4-a7e30c1377f9 req-038d841a-5164-4bfa-86f6-7013276e59a9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032582 May 09 18:43:37.775173 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 481/937] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:37.779002 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Going to try to terminate instance {{(pid=118350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:43:37.865488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-f0c517d5-07db-437a-9809-4de7910ac216 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 204 len: 0 microversion: 2.1 time: 0.126304 May 09 18:43:37.870199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 457/938] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:43:37 2022] DELETE /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:43:37.880678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:37.881435 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:37.890690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:37.891717 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:37.892681 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:37.893344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:38.027136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:38.035301 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-301ec13f-1b4c-4bfb-b3db-2326180c1eac tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1576 microversion: 2.1 time: 0.163737 May 09 18:43:38.035898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 482/939] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:37 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:43:39.058764 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:39.059991 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:39.070647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:39.071652 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:39.073069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:39.073888 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:39.233648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:39.241687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2fafacda-7329-4aca-a5eb-528df5747422 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1576 microversion: 2.1 time: 0.190595 May 09 18:43:39.242268 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 458/940] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:39 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:39.986119 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-363875eb-d1a6-4c5b-9a76-10f5dbfdfed1 req-85fd814e-5530-4806-b3f4-f684c8b6748a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c381236c-6ccf-420b-be56-4f499d767474", "name": "network-vif-deleted", "tag": "ac0bd851-ca4d-4d0c-8d7b-b047915f11f1"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:39.995026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-363875eb-d1a6-4c5b-9a76-10f5dbfdfed1 req-85fd814e-5530-4806-b3f4-f684c8b6748a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:39.995466 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-363875eb-d1a6-4c5b-9a76-10f5dbfdfed1 req-85fd814e-5530-4806-b3f4-f684c8b6748a service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:40.007254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-363875eb-d1a6-4c5b-9a76-10f5dbfdfed1 req-85fd814e-5530-4806-b3f4-f684c8b6748a service nova] Creating event network-vif-deleted:ac0bd851-ca4d-4d0c-8d7b-b047915f11f1 for instance c381236c-6ccf-420b-be56-4f499d767474 on hv-cinder-83588 May 09 18:43:40.012654 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-363875eb-d1a6-4c5b-9a76-10f5dbfdfed1 req-85fd814e-5530-4806-b3f4-f684c8b6748a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030313 May 09 18:43:40.013249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 483/941] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:40.259486 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:40.260136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:40.267420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:40.267867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:40.268674 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:40.269104 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:40.337332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86609452d1a44c9d953ed642936003f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9292fda06d234de8b60b0131b87bbf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:40.345909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-227cabf9-e75f-42da-bb69-a4ddf7634d86 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 200 len: 1224 microversion: 2.1 time: 0.090733 May 09 18:43:40.346877 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 459/942] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:40 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:40.840400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ee869f4c-6ce4-4b7a-b299-b07e945664a0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:43:40.848575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee869f4c-6ce4-4b7a-b299-b07e945664a0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:40.849120 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ee869f4c-6ce4-4b7a-b299-b07e945664a0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:40.912579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ee869f4c-6ce4-4b7a-b299-b07e945664a0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Going to try to stop instance {{(pid=118351) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 18:43:40.961223 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ee869f4c-6ce4-4b7a-b299-b07e945664a0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action" status: 202 len: 0 microversion: 2.1 time: 0.125489 May 09 18:43:40.961839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 484/943] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:43:40 2022] POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:43:40.970168 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:40.970944 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:40.977670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:40.978136 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:40.978926 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:40.979353 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.111315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:41.119787 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-481b9238-ecf6-4b7d-83be-33831450e10f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.153583 May 09 18:43:41.120422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 460/944] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:40 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:41.366910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:41.367680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: c381236c-6ccf-420b-be56-4f499d767474] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:41.374438 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.374885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.375704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.376167 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.390377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] HTTP exception thrown: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Request method failure captured: May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 HTTP/1.1 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV8xxoRTaa-aFmqstUUkR1fjLHOkLMe-5MesavmvB6F3tJNSIKkYb2e_0aBpJij7DXz-Z8Gq_84mAcn2Cci8rlsbTd3JpUAMcL8HlzjngHoJm4qwwCcDdPy-qiM8aDxEl5SbKgFXMZqcWhUQTch9mF13h0GrZzqz7KZDxWiK5fkIbyY May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:43:41.391992 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9292fda06d234de8b60b0131b87bbf46"}]}] May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 86609452d1a44c9d953ed642936003f1 May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. May 09 18:43:41.393618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'c381236c-6ccf-420b-be56-4f499d767474'} May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:43:41.397590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. May 09 18:43:41.399406 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.400643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Returning 404 to user: Instance c381236c-6ccf-420b-be56-4f499d767474 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:43:41.400643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-51a9fa95-ddd4-40bd-ab5c-9caea53f145f tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474" status: 404 len: 111 microversion: 2.1 time: 0.031471 May 09 18:43:41.400643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 485/945] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:41 2022] GET /compute/v2.1/servers/c381236c-6ccf-420b-be56-4f499d767474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:43:41.852372 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:41.852991 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:41.859984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.860422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.861199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.861739 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.876930 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] HTTP exception thrown: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Request method failure captured: May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: DELETE /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 HTTP/1.1 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieV8xxoRTaa-aFmqstUUkR1fjLHOkLMe-5MesavmvB6F3tJNSIKkYb2e_0aBpJij7DXz-Z8Gq_84mAcn2Cci8rlsbTd3JpUAMcL8HlzjngHoJm4qwwCcDdPy-qiM8aDxEl5SbKgFXMZqcWhUQTch9mF13h0GrZzqz7KZDxWiK5fkIbyY May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:43:41.878807 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9292fda06d234de8b60b0131b87bbf46"}]}] May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: 86609452d1a44c9d953ed642936003f1 May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.880427 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '297d06a6-18b9-45b0-9bbe-91cbb3667fa7'} May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:43:41.881249 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.882636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:43:41.884654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Returning 404 to user: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:43:41.884654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-de2a801a-a12b-4066-8a09-d475558bb673 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "DELETE /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 404 len: 111 microversion: 2.1 time: 0.032191 May 09 18:43:41.884654 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 461/946] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:43:41 2022] DELETE /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:43:41.889459 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:41.890071 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] [instance: 297d06a6-18b9-45b0-9bbe-91cbb3667fa7] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:41.896563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.897004 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.897766 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:41.898189 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:41.914829 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] HTTP exception thrown: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Request method failure captured: May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 HTTP/1.1 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieV8xxoRTaa-aFmqstUUkR1fjLHOkLMe-5MesavmvB6F3tJNSIKkYb2e_0aBpJij7DXz-Z8Gq_84mAcn2Cci8rlsbTd3JpUAMcL8HlzjngHoJm4qwwCcDdPy-qiM8aDxEl5SbKgFXMZqcWhUQTch9mF13h0GrZzqz7KZDxWiK5fkIbyY May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:43:41.916410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9292fda06d234de8b60b0131b87bbf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9292fda06d234de8b60b0131b87bbf46"}]}] May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 9292fda06d234de8b60b0131b87bbf46 May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1011275184 May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: 86609452d1a44c9d953ed642936003f1 May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-TestVolumeBootPattern-1011275184-project May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.917919 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': '297d06a6-18b9-45b0-9bbe-91cbb3667fa7'} May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:43:41.918813 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. May 09 18:43:41.920312 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:43:41.921631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Returning 404 to user: Instance 297d06a6-18b9-45b0-9bbe-91cbb3667fa7 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:43:41.921631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c8b5ef79-9610-44c7-8cb5-bfc73c353546 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7" status: 404 len: 111 microversion: 2.1 time: 0.032218 May 09 18:43:41.921631 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 486/947] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:41 2022] GET /compute/v2.1/servers/297d06a6-18b9-45b0-9bbe-91cbb3667fa7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:43:42.138516 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:42.139481 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:42.147229 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:42.147682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:42.148513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:42.148945 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:42.282692 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:42.291093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-85ee0849-17e7-4476-a28a-80c28dcd5eb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.156843 May 09 18:43:42.291663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 462/948] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:42 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:43.244617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-964dd02e-1fc8-4bee-ab46-f45d58444b15 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] Calling method '.version_select at 0x7fe8c3db6820>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:43.265921 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-964dd02e-1fc8-4bee-ab46-f45d58444b15 tempest-TestVolumeBootPattern-1011275184 tempest-TestVolumeBootPattern-1011275184-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006085322" status: 202 len: 0 microversion: 2.1 time: 0.025923 May 09 18:43:43.267178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 487/949] 10.222.0.35 () {58 vars in 1262 bytes} [Mon May 9 18:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006085322 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:43:43.308844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:43.309558 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:43.317765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:43.318538 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:43.319875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:43.320647 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:43.795831 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:43.804464 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-8d91deb3-8084-4448-ba10-e2c0f13286d3 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.499451 May 09 18:43:43.805084 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 463/950] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:43 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:43:44.821932 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:44.822547 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:44.830127 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:44.830573 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:44.831362 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:44.831783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:45.052161 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:45.062679 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0ef1113f-48e6-4599-a9fd-5fc5c3acd222 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.244773 May 09 18:43:45.063442 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 488/951] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:44 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:46.081074 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:46.081632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:46.088448 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:46.088918 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:46.089698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:46.090145 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:46.261466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:46.273461 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d7dbf2f2-3e62-44cc-8402-23254ccfe12f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.196524 May 09 18:43:46.274491 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 464/952] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:46 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:47.290976 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:47.291588 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:47.298950 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:47.299930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:47.301140 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:47.301550 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:47.436931 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:47.445619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bce84de2-71f7-4e6c-8383-2066b40b4b73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.158622 May 09 18:43:47.446310 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 489/953] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:47 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:48.463228 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:48.463865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:48.470301 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:48.471051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:48.472081 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:48.472512 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:48.613382 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:48.621575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-41fb6bba-8814-42e6-a078-b21e111bd546 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.162251 May 09 18:43:48.622874 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 465/954] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:48 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:49.642933 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:49.643699 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:49.651179 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:49.651896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:49.653022 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:49.653724 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:49.867483 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:49.881848 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7e0d8eee-0f9b-4f21-9d57-c93c936a3612 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.245732 May 09 18:43:49.882530 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 490/955] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:49 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:50.898887 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:50.899490 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:50.906438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:50.906884 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:50.907721 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:50.908712 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:51.044221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:51.054380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-57cb810a-01be-490d-bcab-a1c46be5e11b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.159195 May 09 18:43:51.055209 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 466/956] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:50 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:52.072685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:52.073250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:52.080276 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:52.080725 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:52.081502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:52.081934 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:52.211266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:52.220213 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-38579fff-72cb-41e6-b687-1531b3d94a14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.151446 May 09 18:43:52.220822 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 491/957] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:52 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:53.238690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:53.239308 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:53.246217 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:53.246668 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:53.247438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:53.247878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:53.382669 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:53.392080 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4e8eea1d-ced9-417f-b643-7cb71693b623 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.157320 May 09 18:43:53.392704 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 467/958] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:53 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:54.409650 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:54.410299 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:54.417715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:54.418169 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:54.418974 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:54.419408 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:54.551065 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:54.559243 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e010f27e-a3c9-4260-91aa-c08268ea8bd1 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.153861 May 09 18:43:54.559827 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 492/959] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:54 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:55.577568 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:55.578186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:55.585232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:55.585688 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:55.586475 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:55.586920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:55.720156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:55.728819 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e21cebb9-3e68-4a3b-bf0b-408874d30e7e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.155746 May 09 18:43:55.729401 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 468/960] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:55 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:56.746779 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:56.747387 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:56.753611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:56.754060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:56.754823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:56.755254 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:56.886382 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:56.894602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f4d2a579-3717-44d2-a415-730e2f394aa2 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.152063 May 09 18:43:56.895159 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 493/961] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:56 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:57.913657 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:57.914271 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:57.921170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:57.921623 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:57.922393 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:57.922830 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:58.057380 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:58.066015 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-64e8b292-9179-4c72-ac42-94e28659b021 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.157385 May 09 18:43:58.066592 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 469/962] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:57 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:43:59.083143 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:43:59.083733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:43:59.090334 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:59.090787 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:59.091770 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:43:59.092233 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:43:59.226825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:43:59.234948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-4ae56095-e65f-4380-85a9-d1f2db812089 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.155828 May 09 18:43:59.235523 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 494/963] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:43:59 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:00.253151 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:00.253730 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:00.261014 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:00.261396 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:00.262178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:00.262617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:00.391439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:00.399888 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-b85d46ec-c3ab-4da5-8414-4f40d9233d65 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1723 microversion: 2.1 time: 0.150728 May 09 18:44:00.400504 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 470/964] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:00 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:01.417246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:01.417899 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:01.425461 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.425910 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.426814 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.427248 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.565105 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:01.573620 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7ac06d05-ed34-4611-ab94-ad1fbb6f2e73 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1700 microversion: 2.1 time: 0.160345 May 09 18:44:01.574204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 495/965] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:01 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:01.590651 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-109f85cf-6f1e-4072-bd21-49b151a21c97 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:01.597736 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-109f85cf-6f1e-4072-bd21-49b151a21c97 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.598198 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-109f85cf-6f1e-4072-bd21-49b151a21c97 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.659110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-109f85cf-6f1e-4072-bd21-49b151a21c97 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Going to try to start instance {{(pid=118350) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 18:44:01.703162 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-109f85cf-6f1e-4072-bd21-49b151a21c97 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action" status: 202 len: 0 microversion: 2.1 time: 0.116230 May 09 18:44:01.703687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 471/966] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:44:01 2022] POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:44:01.712248 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:01.712897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:01.718990 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.719501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.720316 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.720751 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.852622 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:01.860935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8446fe09-1b85-4e5b-9f9f-8d9a6a94767d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1709 microversion: 2.1 time: 0.152431 May 09 18:44:01.861740 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 496/967] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:01 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:02.879847 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:02.880871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:02.887922 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:02.888408 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:02.889191 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:02.889632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:03.033925 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:03.042254 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-904d0155-2cb5-42cc-8be1-f0de5dbf2382 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1709 microversion: 2.1 time: 0.167424 May 09 18:44:03.042839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 472/968] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:02 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:04.060027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:04.060656 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:04.067678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:04.068168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:04.068951 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:04.069389 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:04.200164 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:04.208632 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-aac926ea-8089-430d-8fe8-02da159c8270 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1713 microversion: 2.1 time: 0.152573 May 09 18:44:04.209204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 497/969] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:04 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:36.747110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:36.748218 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:36.756315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:36.757135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:36.757957 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:36.758391 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:36.856911 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lazy-loading 'services' on Instance uuid b0987980-b2da-4bb2-a241-0b913e917826 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:44:36.928682 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42eb773e-3018-4387-b85c-6f056624de9f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments/7913eab6-2c5a-4fda-9387-8694c1e00027" status: 202 len: 0 microversion: 2.1 time: 0.185860 May 09 18:44:36.929275 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 473/970] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:44:36 2022] DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments/7913eab6-2c5a-4fda-9387-8694c1e00027 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:44:38.040639 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-e0965731-a21e-4571-995c-64e2aadfd031 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:38.047739 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0965731-a21e-4571-995c-64e2aadfd031 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:38.048399 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-e0965731-a21e-4571-995c-64e2aadfd031 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:38.071164 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-e0965731-a21e-4571-995c-64e2aadfd031 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Going to try to stop instance {{(pid=118351) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 18:44:38.114506 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-e0965731-a21e-4571-995c-64e2aadfd031 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action" status: 202 len: 0 microversion: 2.1 time: 0.077811 May 09 18:44:38.115104 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 498/971] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:44:38 2022] POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:44:38.124776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:38.125530 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:38.132672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:38.133124 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:38.133898 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:38.134337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:38.270333 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:38.279265 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0f16c15a-0677-46b1-a522-4e36212b7819 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.159482 May 09 18:44:38.279859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 474/972] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:38 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:39.299094 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:39.299856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:39.306668 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:39.307110 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:39.307980 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:39.308447 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:39.443751 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:39.452496 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b9737ca3-e0d6-4d88-8dbc-bf174f75a084 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.158798 May 09 18:44:39.453055 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 499/973] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:39 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:40.471635 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:40.472268 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:40.479330 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:40.480259 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:40.481058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:40.481497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:40.617312 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:40.625095 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7e18a618-fd8f-48fc-9839-abfcb544bbf0 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.157649 May 09 18:44:40.625671 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 475/974] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:40 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:41.642963 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:41.643659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:41.650598 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:41.651046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:41.651825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:41.652297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:41.787150 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:41.795113 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-bb0f31b1-a4fd-45c6-b468-e48baa7e5821 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.156111 May 09 18:44:41.795698 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 500/975] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:41 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:42.813285 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:42.813846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:42.821638 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:42.822186 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:42.823079 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:42.823519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:42.954433 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:42.962346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5306f91a-e9c6-4c83-9794-0901d3c8bbe9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.153131 May 09 18:44:42.962914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 476/976] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:42 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:43.980053 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:43.981463 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:43.988640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:43.989183 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:43.990066 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:43.990558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:44.137329 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:44.146020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-81b1ae8c-3409-457e-ae8b-fb99c7859bb8 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.170036 May 09 18:44:44.146641 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 501/977] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:43 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:45.163989 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:45.164597 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:45.171403 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:45.171856 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:45.172690 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:45.173129 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:45.304636 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:45.312980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-56f151b1-3ecc-4234-b3c3-cd8abb22a0df tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.152924 May 09 18:44:45.313786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 477/978] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:45 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:46.331917 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:46.332685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:46.339075 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:46.339526 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:46.340333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:46.340772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:46.469750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:46.477849 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ecdf0dd3-0456-49e1-842b-4136b3fa178b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.150141 May 09 18:44:46.478424 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 502/979] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:46 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:47.499135 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:47.500133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:47.508133 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:47.508583 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:47.509348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:47.509783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:47.650361 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:47.658594 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5aa79cbf-0c5f-4425-aeb7-716cdc6715e7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1677 microversion: 2.1 time: 0.166090 May 09 18:44:47.659171 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 478/980] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:47 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:48.678970 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:48.679599 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:48.686497 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:48.686948 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:48.687728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:48.688204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:48.821089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:48.828772 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9bf9b98c-00e1-4f02-b5eb-17d3b5eed2bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1654 microversion: 2.1 time: 0.153765 May 09 18:44:48.829348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 503/981] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:48 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:48.845386 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-315de8bc-04ac-4ed0-a34c-99dd41c1e14d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:48.852719 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-315de8bc-04ac-4ed0-a34c-99dd41c1e14d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:48.853170 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-315de8bc-04ac-4ed0-a34c-99dd41c1e14d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:48.875648 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-315de8bc-04ac-4ed0-a34c-99dd41c1e14d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Going to try to start instance {{(pid=118350) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 18:44:48.924284 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-315de8bc-04ac-4ed0-a34c-99dd41c1e14d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action" status: 202 len: 0 microversion: 2.1 time: 0.082716 May 09 18:44:48.925021 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 479/982] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:44:48 2022] POST /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:44:48.933269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:48.933991 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:48.940403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:48.940862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:48.941648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:48.942083 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:49.108685 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:49.116705 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ea58581d-ce65-4da6-ae7c-30a25992d766 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1663 microversion: 2.1 time: 0.187283 May 09 18:44:49.126335 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 504/983] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:48 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1663 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:50.136441 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:50.137160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:50.144283 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:50.144756 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:50.145575 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:50.146034 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:50.283599 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:50.291681 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2d31a5a7-547a-4e85-b459-7a9d00a2a753 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1663 microversion: 2.1 time: 0.160945 May 09 18:44:50.292333 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 480/984] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:50 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:51.311797 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:51.312450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:51.319168 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:51.319618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:51.320434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:51.320862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:51.452001 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:51.460012 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d6d32264-bf86-41d5-aaeb-8698fe559a9e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1667 microversion: 2.1 time: 0.152191 May 09 18:44:51.460614 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 505/985] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:44:51 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:54.835711 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:44:54.836832 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:44:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:44:56.966788 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:44:56.967853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:45:23.693115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:23.694138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:23.700838 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.701295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:23.702103 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.702545 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:23.732614 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-7510c82f-988d-4395-8c12-7db8bb4e481d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043820 May 09 18:45:23.733153 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 481/986] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:45:23 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:45:23.803390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:23.803942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:23.810372 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.810820 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:23.811594 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.812077 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:23.837097 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:45:23.924167 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-edb1d5ef-d7ff-4340-879e-fe182a4b8628 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 204 len: 0 microversion: 2.1 time: 0.124402 May 09 18:45:23.925238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 506/987] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:45:23 2022] DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:45:23.933602 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:23.934213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:23.940260 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.940703 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:23.941493 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:23.941930 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:24.080895 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:24.088844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6149d2e4-2e8f-4f53-8800-97e68b7d8a5b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1673 microversion: 2.1 time: 0.159312 May 09 18:45:24.089415 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 482/988] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:23 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:25.111896 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:25.113151 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:25.123409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:25.124225 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:25.125495 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:25.126209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:25.271942 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:25.280308 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c0bdf280-f7b6-477e-8477-f3844a77c07b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1673 microversion: 2.1 time: 0.175447 May 09 18:45:25.280887 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 507/989] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:25 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:26.298765 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:26.299346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:26.305980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:26.306465 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:26.307242 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:26.307680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:26.375039 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:26.384381 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1266ba81-48e0-4584-9f49-78c1a5d2602c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1605 microversion: 2.1 time: 0.089363 May 09 18:45:26.394120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 483/990] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:26 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:26.666366 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-fa9fff91-a6d0-462c-8492-610989f57d85 req-e2eb7074-f746-4819-8101-b4345a3e1f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0987980-b2da-4bb2-a241-0b913e917826", "name": "network-vif-deleted", "tag": "ce24fd0d-26e0-47af-afb6-fe20e0c212a4"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:26.677116 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-fa9fff91-a6d0-462c-8492-610989f57d85 req-e2eb7074-f746-4819-8101-b4345a3e1f31 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:26.678670 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-fa9fff91-a6d0-462c-8492-610989f57d85 req-e2eb7074-f746-4819-8101-b4345a3e1f31 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:26.690020 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-fa9fff91-a6d0-462c-8492-610989f57d85 req-e2eb7074-f746-4819-8101-b4345a3e1f31 service nova] Creating event network-vif-deleted:ce24fd0d-26e0-47af-afb6-fe20e0c212a4 for instance b0987980-b2da-4bb2-a241-0b913e917826 on hv-cinder-83588 May 09 18:45:26.696855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-fa9fff91-a6d0-462c-8492-610989f57d85 req-e2eb7074-f746-4819-8101-b4345a3e1f31 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 May 09 18:45:26.697525 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 508/991] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:45:27.401700 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:27.403036 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:27.409693 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:27.410232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:27.410927 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:27.411357 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:27.445346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:27.445877 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:27.446492 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lazy-loading 'fault' on Instance uuid b0987980-b2da-4bb2-a241-0b913e917826 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:45:27.763060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:27.770038 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-78bc5381-946e-4ba3-a7b8-a6c9b734b5fd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 200 len: 1327 microversion: 2.1 time: 0.372403 May 09 18:45:27.770771 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 484/992] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:27 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 1327 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:28.791930 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:28.792705 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:28.799816 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:28.800297 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:28.801073 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:28.801501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:28.815457 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 HTTP/1.1 May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:45:28.817117 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:45:28.818783 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'b0987980-b2da-4bb2-a241-0b913e917826'} May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:45:28.819703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:45:28.821174 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:45:28.822394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:45:28.822394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-9af703e0-b11d-4634-ac85-5ede4dd54ec4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 404 len: 111 microversion: 2.1 time: 0.032838 May 09 18:45:28.822394 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 509/993] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:28 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:45:28.828069 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d19110a6-7ab0-4154-8164-8513eabd964a tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '.version_select at 0x7fe8bac00ee0>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:28.850653 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d19110a6-7ab0-4154-8164-8513eabd964a tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975661816" status: 202 len: 0 microversion: 2.1 time: 0.026637 May 09 18:45:28.851251 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 485/994] 10.222.0.35 () {58 vars in 1217 bytes} [Mon May 9 18:45:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975661816 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:45:29.790802 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-902d2ad0-cd60-40c7-9b12-82c612096847 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: .version_select at 0x7fe8c3dd73a0>, body: {"keypair": {"name": "tempest-keypair-276766706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP54GxGk436Inb84JKWVLuBvQ8c66rldM+GQASQEN6S5twUEoxVTNJtoGt1+OdhXHGnzxRGanjXhOZVAsLoh65r608nF8y//tZihajaAgTaR36+D1sgpI86a9M9LzJMf/g=="}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:29.806663 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-902d2ad0-cd60-40c7-9b12-82c612096847 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:45:29.810658 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-902d2ad0-cd60-40c7-9b12-82c612096847 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for user b50fae7cb7f645d7ade69c2e9135f8f0 and project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'key_pairs'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:45:29.834805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-902d2ad0-cd60-40c7-9b12-82c612096847 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048128 May 09 18:45:29.835379 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 510/995] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:45:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:45:31.155204 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1922651742", "imageRef": "a803ebd5-9c5f-4455-83af-fc2d03764781", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b55eb03-22f4-4dc1-9347-3cca06936c12"}], "security_groups": [{"name": "tempest-securitygroup--437465815"}], "key_name": "tempest-keypair-276766706", "user_data": "}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:31.263078 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.network.neutron [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] validate_networks() for [('4b55eb03-22f4-4dc1-9347-3cca06936c12', None, None, None, None, None)] {{(pid=118350) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:45:31.634933 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Flavor limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:45:31.635355 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Image limits 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:45:31.635839 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Flavor pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:45:31.636287 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Image pref 0:0:0 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:45:31.636706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.virt.hardware [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:45:31.651073 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:31.651522 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:31.652356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:31.652788 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:31.669178 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:45:31.673127 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Getting quotas for user b50fae7cb7f645d7ade69c2e9135f8f0 and project 7d0a5b9db87741c3b14739ca0ed96a1c. Resources: {'instances', 'ram', 'cores'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:45:31.684116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Going to run 1 instances... {{(pid=118350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:45:31.686421 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a803ebd5-9c5f-4455-83af-fc2d03764781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:45:31.739679 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-81a1bc8d-35ed-4a93-aa2d-c7ba5fa4a6c5 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591902 May 09 18:45:31.740343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 486/996] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:45:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:45:31.750968 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-20cc50c6-f489-469d-8f30-6fbb27098774 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:31.751626 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-20cc50c6-f489-469d-8f30-6fbb27098774 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:31.807454 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-20cc50c6-f489-469d-8f30-6fbb27098774 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:31.814765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-20cc50c6-f489-469d-8f30-6fbb27098774 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1237 microversion: 2.1 time: 0.068017 May 09 18:45:31.815304 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 511/997] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:31 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:32.832250 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:32.832871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:32.839350 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:32.839806 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:32.840629 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:32.841067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:32.910076 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:32.919502 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-3152dcf7-792c-4431-a64c-a0c578860edd tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1295 microversion: 2.1 time: 0.091312 May 09 18:45:32.920794 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 487/998] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:32 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:33.937160 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:33.937893 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:33.945488 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:33.946050 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:33.947063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:33.947764 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:34.092955 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:34.101034 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-fe1eaf60-ccb4-4626-81e6-657d444e71da tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.167979 May 09 18:45:34.101610 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 512/999] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:33 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:34.122343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-c94fa608-22b3-49fa-afc8-59cf1e6fab18 req-b02a805a-8a32-4da8-a789-d3df71879e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c1596f-910d-462b-a7e0-f268d1ccdcbe", "tag": "fe838ea2-4633-423f-9e57-a65dc18b8cb5"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:34.142231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c94fa608-22b3-49fa-afc8-59cf1e6fab18 req-b02a805a-8a32-4da8-a789-d3df71879e7c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:34.142694 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c94fa608-22b3-49fa-afc8-59cf1e6fab18 req-b02a805a-8a32-4da8-a789-d3df71879e7c service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:34.155412 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-c94fa608-22b3-49fa-afc8-59cf1e6fab18 req-b02a805a-8a32-4da8-a789-d3df71879e7c service nova] Creating event network-changed:fe838ea2-4633-423f-9e57-a65dc18b8cb5 for instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe on hv-cinder-83588 May 09 18:45:34.161011 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-c94fa608-22b3-49fa-afc8-59cf1e6fab18 req-b02a805a-8a32-4da8-a789-d3df71879e7c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042947 May 09 18:45:34.161943 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 488/1000] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:45:35.121885 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:35.122901 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:35.134267 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:35.135013 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:35.136335 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:35.137064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:35.273886 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:35.281566 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a0e7b6b9-a6eb-4924-a1f7-3d3d33544f31 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.166387 May 09 18:45:35.282136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 513/1001] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:35 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:36.304199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:36.305416 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:36.316838 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:36.317601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:36.318890 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:36.319621 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:36.462494 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:36.470734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6e91ce2f-ed1c-409d-9488-2b4b43f6ea2e tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.173938 May 09 18:45:36.471305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 489/1002] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:36 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:37.487935 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:37.488611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:37.495147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:37.495606 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:37.496405 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:37.496857 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:37.624695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:37.632402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-b6adb87b-16e0-48db-9e9d-b6f61a9e521c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.148373 May 09 18:45:37.632977 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 514/1003] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:37 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:38.653980 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:38.655099 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:38.661974 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:38.662456 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:38.663236 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:38.663686 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:38.796510 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:38.803929 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-fe72a814-2641-437f-ad9a-83ba26097cf4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.156596 May 09 18:45:38.804696 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 490/1004] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:38 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:39.540333 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-89eae7d6-41f3-4f4d-865c-e3581ace22e6 req-6fb25dfc-8e0b-4ac6-8635-fa929350b7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1596f-910d-462b-a7e0-f268d1ccdcbe", "name": "network-vif-plugged", "status": "completed", "tag": "fe838ea2-4633-423f-9e57-a65dc18b8cb5"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:39.550799 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-89eae7d6-41f3-4f4d-865c-e3581ace22e6 req-6fb25dfc-8e0b-4ac6-8635-fa929350b7ff service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:39.551409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-89eae7d6-41f3-4f4d-865c-e3581ace22e6 req-6fb25dfc-8e0b-4ac6-8635-fa929350b7ff service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:39.562961 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-89eae7d6-41f3-4f4d-865c-e3581ace22e6 req-6fb25dfc-8e0b-4ac6-8635-fa929350b7ff service nova] Creating event network-vif-plugged:fe838ea2-4633-423f-9e57-a65dc18b8cb5 for instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe on hv-cinder-83588 May 09 18:45:39.567906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-89eae7d6-41f3-4f4d-865c-e3581ace22e6 req-6fb25dfc-8e0b-4ac6-8635-fa929350b7ff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031535 May 09 18:45:39.568694 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 515/1005] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:45:39.821467 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:39.822112 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:39.829295 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:39.829738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:39.830511 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:39.830953 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:39.979398 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:39.989473 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-d3febf90-4849-431e-a6f1-7fbdec44bb14 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.172143 May 09 18:45:39.990065 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 491/1006] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:39 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:41.012906 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:41.014032 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:41.024344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:41.025084 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:41.026348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:41.027063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:41.165202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:41.172842 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-099cd05c-86f7-44e8-b291-e66f32a87369 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1362 microversion: 2.1 time: 0.168201 May 09 18:45:41.173415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 516/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:41 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:42.194187 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:42.195219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:42.205348 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:42.205821 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:42.206605 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:42.207088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:42.344060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:45:42.351795 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1e8db93b-97a9-467f-8802-09cc3e32e4fe tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1547 microversion: 2.1 time: 0.164297 May 09 18:45:42.352579 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 492/1008] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:45:42 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:45:42.368676 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:45:42.369273 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:45:42.376662 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:42.377118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:42.377897 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:42.378344 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:42.455100 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d12fded3-987a-496a-ad6d-83d10c892c63 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090321 May 09 18:45:42.455750 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 517/1009] 10.222.0.35 () {58 vars in 1274 bytes} [Mon May 9 18:45:42 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:45:43.474371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-e3749733-9590-4bfe-9900-08fe850e885c req-6e8378a0-6685-4c1b-856d-fda98c52c7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c1596f-910d-462b-a7e0-f268d1ccdcbe", "tag": "fe838ea2-4633-423f-9e57-a65dc18b8cb5"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:45:43.483445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e3749733-9590-4bfe-9900-08fe850e885c req-6e8378a0-6685-4c1b-856d-fda98c52c7be service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:45:43.484173 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e3749733-9590-4bfe-9900-08fe850e885c req-6e8378a0-6685-4c1b-856d-fda98c52c7be service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:45:43.498738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-e3749733-9590-4bfe-9900-08fe850e885c req-6e8378a0-6685-4c1b-856d-fda98c52c7be service nova] Creating event network-changed:fe838ea2-4633-423f-9e57-a65dc18b8cb5 for instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe on hv-cinder-83588 May 09 18:45:43.504221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-e3749733-9590-4bfe-9900-08fe850e885c req-6e8378a0-6685-4c1b-856d-fda98c52c7be service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033741 May 09 18:45:43.505356 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 493/1010] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:17.791044 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:17.791751 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:17.799250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:17.799705 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:17.800524 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:17.800962 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:17.825262 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-3dadea01-28b2-4c8d-a69c-88bb08119c03 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/ips" status: 200 len: 144 microversion: 2.1 time: 0.041689 May 09 18:46:17.825868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 518/1011] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:46:17 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:19.166943 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90373df0-898f-4095-9b8b-26bf5f914a29"}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:46:19.168176 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:19.174706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:19.175138 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:19.175932 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:19.176392 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:19.430094 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-eb91c678-a277-4987-b250-829abec0309b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268013 May 09 18:46:19.430723 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 494/1012] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:46:19 2022] POST /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:25.913617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:25.914561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:25.921098 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:25.921551 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:25.922320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:25.922755 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:25.951261 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-da85e4e2-1d60-441c-a019-14223f41bfde tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 May 09 18:46:25.951786 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 519/1013] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:46:25 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:25.963053 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:25.963604 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:25.970482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:25.970934 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:25.971716 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:25.972199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:26.000557 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-64ad2498-91d6-4360-b27d-213c8149b154 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29" status: 200 len: 194 microversion: 2.1 time: 0.042540 May 09 18:46:26.001118 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 495/1014] 10.222.0.35 () {58 vars in 1412 bytes} [Mon May 9 18:46:25 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:27.344637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0c9457c-9e1f-49aa-ad1d-e23871919cda"}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:46:27.345715 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:27.352602 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:27.353042 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:27.353807 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:27.354237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:27.615754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8bae328b-70de-441c-a936-02a99cfc651b tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "POST /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274928 May 09 18:46:27.617404 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 520/1015] 10.222.0.35 () {60 vars in 1322 bytes} [Mon May 9 18:46:27 2022] POST /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:34.093028 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:34.093976 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:34.100875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.101327 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.102093 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.102551 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.133046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0dcf69cc-3bf6-4374-a9c5-e63d041fd4b4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044045 May 09 18:46:34.133631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 496/1016] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:46:34 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:34.281986 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:34.282718 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:34.291107 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.291558 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.292377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.292805 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.323060 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2ddd136c-b72d-4c0f-8573-ab85cd258610 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29" status: 200 len: 194 microversion: 2.1 time: 0.046710 May 09 18:46:34.323621 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 521/1017] 10.222.0.35 () {58 vars in 1412 bytes} [Mon May 9 18:46:34 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:34.338767 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:34.339478 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:34.348940 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.349630 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.350920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:34.351590 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:34.431853 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lazy-loading 'services' on Instance uuid e9c1596f-910d-462b-a7e0-f268d1ccdcbe {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:46:34.505908 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9fbf79a4-38ea-45cd-b89d-276cd0a398ff tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29" status: 202 len: 0 microversion: 2.1 time: 0.173526 May 09 18:46:34.506530 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 497/1018] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:46:34 2022] DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/90373df0-898f-4095-9b8b-26bf5f914a29 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:46:35.623915 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:35.624522 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:35.631520 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:35.631985 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:35.632792 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:35.633218 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:35.663280 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c0e8ac1c-e82a-4d5d-b203-9e3020417dc9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/e0c9457c-9e1f-49aa-ad1d-e23871919cda" status: 200 len: 194 microversion: 2.1 time: 0.043399 May 09 18:46:35.663880 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 522/1019] 10.222.0.35 () {58 vars in 1412 bytes} [Mon May 9 18:46:35 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/e0c9457c-9e1f-49aa-ad1d-e23871919cda => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:35.675199 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:35.675846 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:35.682405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:35.682858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:35.683607 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:35.684067 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:35.765270 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lazy-loading 'services' on Instance uuid e9c1596f-910d-462b-a7e0-f268d1ccdcbe {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:46:35.837919 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-1948a988-1ab0-4235-b434-58faa6c188c7 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/e0c9457c-9e1f-49aa-ad1d-e23871919cda" status: 202 len: 0 microversion: 2.1 time: 0.167389 May 09 18:46:35.838510 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 498/1020] 10.222.0.35 () {58 vars in 1415 bytes} [Mon May 9 18:46:35 2022] DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments/e0c9457c-9e1f-49aa-ad1d-e23871919cda => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:46:37.006946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:37.008087 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:37.017628 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.018191 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.019178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.019703 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.052122 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-90ef65d9-81d9-4a09-891f-9a66fb7496bc tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051951 May 09 18:46:37.052654 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 523/1021] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:46:36 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:46:37.173057 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:37.174131 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:37.181054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.181497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.182263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.182687 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.215533 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-4b693d8e-9f90-4524-b963-2c39e83db493 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047337 May 09 18:46:37.216115 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 499/1022] 10.222.0.35 () {58 vars in 1301 bytes} [Mon May 9 18:46:37 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:46:37.273396 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:37.273922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:37.280114 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.280562 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.281325 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.281753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.305960 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:46:37.388982 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a619eac5-ef32-4220-bb2b-a9fafe641ac4 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 204 len: 0 microversion: 2.1 time: 0.119194 May 09 18:46:37.389618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 524/1023] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:46:37 2022] DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:46:37.398182 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:37.398804 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:37.405100 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.405522 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.406281 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:37.406777 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:37.754600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:46:37.762786 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-100f8eb4-4a75-4f46-a85a-a85f24106d5c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1671 microversion: 2.1 time: 0.368541 May 09 18:46:37.763334 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 500/1024] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:37 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1671 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:46:38.785563 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:38.786648 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:38.794788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:38.795249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:38.796052 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:38.796489 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:38.944531 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:46:38.952436 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-aa408848-10ac-4af2-8856-65adc11acf7f tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1671 microversion: 2.1 time: 0.174143 May 09 18:46:38.953016 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 525/1025] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:38 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:46:39.969486 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:39.970068 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:39.977134 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:39.977749 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:39.978547 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:39.978969 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:40.043553 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50fae7cb7f645d7ade69c2e9135f8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0a5b9db87741c3b14739ca0ed96a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:46:40.051405 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-609e3414-7cec-44f1-9aef-24911c2b7201 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 200 len: 1604 microversion: 2.1 time: 0.086023 May 09 18:46:40.052273 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 501/1026] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:39 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 1604 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:46:40.195027 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-bce3ec33-1972-48a6-8462-056082203ac2 req-49de9f2e-8297-40df-a33e-15c4a9cf494f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1596f-910d-462b-a7e0-f268d1ccdcbe", "name": "network-vif-deleted", "tag": "fe838ea2-4633-423f-9e57-a65dc18b8cb5"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:46:40.205069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-bce3ec33-1972-48a6-8462-056082203ac2 req-49de9f2e-8297-40df-a33e-15c4a9cf494f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:40.205923 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-bce3ec33-1972-48a6-8462-056082203ac2 req-49de9f2e-8297-40df-a33e-15c4a9cf494f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:40.217825 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-bce3ec33-1972-48a6-8462-056082203ac2 req-49de9f2e-8297-40df-a33e-15c4a9cf494f service nova] Creating event network-vif-deleted:fe838ea2-4633-423f-9e57-a65dc18b8cb5 for instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe on hv-cinder-83588 May 09 18:46:40.223352 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-bce3ec33-1972-48a6-8462-056082203ac2 req-49de9f2e-8297-40df-a33e-15c4a9cf494f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 May 09 18:46:40.223858 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 526/1027] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:46:41.069907 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:41.070513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:41.077646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:41.078117 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:41.078899 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:41.079333 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:41.093958 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe HTTP/1.1 May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:46:41.095476 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:41.096892 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e9c1596f-910d-462b-a7e0-f268d1ccdcbe'} May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:46:41.097680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:41.098977 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:41.100290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:46:41.100290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-81ecc9ae-0771-4fe8-9213-8b410bf29d72 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 404 len: 111 microversion: 2.1 time: 0.031708 May 09 18:46:41.100290 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 502/1028] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:41 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:46:41.110199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f0893a38-0105-4e9c-af5a-aa2f16739926 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '.version_select at 0x7fe8c3ddadc0>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:41.130894 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f0893a38-0105-4e9c-af5a-aa2f16739926 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276766706" status: 202 len: 0 microversion: 2.1 time: 0.025014 May 09 18:46:41.131477 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 527/1029] 10.222.0.35 () {58 vars in 1217 bytes} [Mon May 9 18:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276766706 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:46:43.523441 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:46:43.524109 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:46:44.036304 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:44.036815 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:44.045063 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:44.045519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:44.046299 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:44.046740 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:44.061805 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe HTTP/1.1 May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:46:44.063809 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.065462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'e9c1596f-910d-462b-a7e0-f268d1ccdcbe'} May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:46:44.066482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.068043 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:44.069985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:46:44.069985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-207e61b7-a8e7-4565-8e7b-99ba3985d63d tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 404 len: 111 microversion: 2.1 time: 0.035626 May 09 18:46:44.069985 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 503/1030] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:46:44 2022] DELETE /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:46:44.074831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:44.075580 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: e9c1596f-910d-462b-a7e0-f268d1ccdcbe] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:44.082868 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:44.083319 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:44.084135 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:44.084579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:44.098081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe HTTP/1.1 May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:46:44.099716 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.101271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'e9c1596f-910d-462b-a7e0-f268d1ccdcbe'} May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:46:44.102147 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. May 09 18:46:44.103494 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:44.104667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance e9c1596f-910d-462b-a7e0-f268d1ccdcbe could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:46:44.104667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-13868f93-2408-42f5-b464-2dc0014aa0c9 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe" status: 404 len: 111 microversion: 2.1 time: 0.030461 May 09 18:46:44.104667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 528/1031] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:44 2022] GET /compute/v2.1/servers/e9c1596f-910d-462b-a7e0-f268d1ccdcbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:46:45.264324 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:45.264901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:45.271857 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:45.272331 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:45.273137 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:45.273569 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:45.288339 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 HTTP/1.1 May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:46:45.289906 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.291442 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': 'b0987980-b2da-4bb2-a241-0b913e917826'} May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:46:45.292365 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.293859 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:46:45.295394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:46:45.295394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-86344fcf-4eaa-4ef5-bb60-cea1f9a25294 tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 404 len: 111 microversion: 2.1 time: 0.033030 May 09 18:46:45.295394 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 504/1032] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:46:45 2022] DELETE /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:46:45.300244 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:46:45.300778 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] [instance: b0987980-b2da-4bb2-a241-0b913e917826] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:46:45.309937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:45.310392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:45.311156 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:46:45.311600 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:46:45.325178 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.wsgi [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] HTTP exception thrown: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Request method failure captured: May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: request: GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 HTTP/1.1 May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept: application/json May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Accept-Encoding: identity May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Connection: close May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Length: 0 May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Content-Type: application/json May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Host: 10.222.0.35 May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Openstack-System-Scope: None May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: User-Agent: python-urllib3/1.26.9 May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Auth-Token: gAAAAABieWCghdtxDkKho8p88AW6_0nOEwRqqZVlbW_sbCWPBqhbhd4NjCHngPb508u77aRJwShNNgdJoPz0z-kVd-2PWOtki9wXUGnSr1IrkI8AfLG5OicAtGbYLIQtke2BnoiTTQehDRHlmhdbUsd_89fCnF50IupOnz8HhdbRkt9ImVmZIxA May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Id: None May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Domain-Name: None May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Identity-Status: Confirmed May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Is-Admin-Project: True May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Id: default May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Domain-Name: Default May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Project-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Role: member,reader May 09 18:46:45.326695 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Roles: member,reader May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7d0a5b9db87741c3b14739ca0ed96a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7d0a5b9db87741c3b14739ca0ed96a1c"}]}] May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Id: 7d0a5b9db87741c3b14739ca0ed96a1c May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1183956347 May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Id: default May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Domain-Name: Default May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Id: b50fae7cb7f645d7ade69c2e9135f8f0 May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: X-User-Name: tempest-AttachVolumeTestJSON-1183956347-project May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: method: > May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: exception: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.328289 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: action_args: {'id': 'b0987980-b2da-4bb2-a241-0b913e917826'} May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:46:45.329171 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. May 09 18:46:45.330579 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR nova.api.openstack.wsgi May 09 18:46:45.331898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] Returning 404 to user: Instance b0987980-b2da-4bb2-a241-0b913e917826 could not be found. {{(pid=118351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:46:45.331898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f7cbde0a-8770-48c2-9842-438a5e1b195c tempest-AttachVolumeTestJSON-1183956347 tempest-AttachVolumeTestJSON-1183956347-project] 10.222.0.35 "GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826" status: 404 len: 111 microversion: 2.1 time: 0.031927 May 09 18:46:45.331898 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 529/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:46:45 2022] GET /compute/v2.1/servers/b0987980-b2da-4bb2-a241-0b913e917826 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:47:57.882660 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Action: 'create', calling method: .version_select at 0x7fe8baeb43a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-43871121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+TAguLb4OOaJvwm86LqDKAm5inOAPdAqiJYuS/FrB0QgqgigOV6Y21dpqkZ5PUB9H0UtvoktMd6b0DoTCNKm3R7Rft6RfJCx/xh6hIY2XSxXJiybhnKsuVBGSqtUYXtQ=="}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:47:57.896293 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Getting quotas for project 2b3f388007834b3fa50e343bc94b9494. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:47:57.900105 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.quota [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Getting quotas for user c2ed2c21d3b04aaa8d45c1be4c2f2481 and project 2b3f388007834b3fa50e343bc94b9494. Resources: {'key_pairs'} {{(pid=118350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:47:57.911900 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [121e6c61-3d3e-475f-ac01-94c6c6713f04] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 18:47:58.920631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [121e6c61-3d3e-475f-ac01-94c6c6713f04] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 34568. May 09 18:47:58.939202 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-6714af63-07ba-4ed8-8495-4a7d1128c010 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 1.233200 May 09 18:47:58.939920 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 505/1034] 10.222.0.35 () {60 vars in 1158 bytes} [Mon May 9 18:47:57 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:48:14.062995 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2061885499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-43871121", "security_groups": [{"name": "tempest-secgroup-smoke-1953925630"}], "networks": [{"uuid": "d0657d0a-f51f-47c1-b908-016aca6b286a"}], "block_device_mapping_v2": [{"uuid": "5eb49bb2-69c2-42a9-8272-ea7ad90af3ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:48:14.306417 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.network.neutron [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] validate_networks() for [('d0657d0a-f51f-47c1-b908-016aca6b286a', None, None, None, None, None)] {{(pid=118351) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:48:14.806367 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Flavor limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:48:14.806794 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Image limits 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:48:14.807271 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Flavor pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:48:14.807680 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Image pref 0:0:0 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:48:14.808133 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.virt.hardware [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:48:14.817970 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:14.818421 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:14.819405 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:14.819837 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:14.837498 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Getting quotas for project 2b3f388007834b3fa50e343bc94b9494. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:48:14.842014 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.quota [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Getting quotas for user c2ed2c21d3b04aaa8d45c1be4c2f2481 and project 2b3f388007834b3fa50e343bc94b9494. Resources: {'instances', 'ram', 'cores'} {{(pid=118351) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:48:14.846329 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:48:14.846851 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:48:14.909682 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Going to run 1 instances... {{(pid=118351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:48:14.911913 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5eb49bb2-69c2-42a9-8272-ea7ad90af3ce',volume_size=None,volume_type=None)] {{(pid=118351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:48:15.048499 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-d1c47a53-0245-48d9-b0c1-80798262cde9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.992759 May 09 18:48:15.049142 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 530/1035] 10.222.0.35 () {60 vars in 1146 bytes} [Mon May 9 18:48:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:48:15.060874 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-ccde94d0-fcf9-430b-80aa-cb350b36bddf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:15.061611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-ccde94d0-fcf9-430b-80aa-cb350b36bddf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:15.119885 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-ccde94d0-fcf9-430b-80aa-cb350b36bddf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:15.127617 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-ccde94d0-fcf9-430b-80aa-cb350b36bddf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1087 microversion: 2.1 time: 0.072240 May 09 18:48:15.128230 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 506/1036] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:15 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:16.145320 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f231738c-4468-4497-a2b2-8fc1de0250a8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:16.145958 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f231738c-4468-4497-a2b2-8fc1de0250a8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:16.197843 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f231738c-4468-4497-a2b2-8fc1de0250a8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:16.204643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f231738c-4468-4497-a2b2-8fc1de0250a8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1087 microversion: 2.1 time: 0.063287 May 09 18:48:16.214081 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 531/1037] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:16 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:17.226008 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a8a7b223-004d-4726-af70-dc9473f08ead tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:17.226959 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a8a7b223-004d-4726-af70-dc9473f08ead tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:17.296593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a8a7b223-004d-4726-af70-dc9473f08ead tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:17.305797 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a8a7b223-004d-4726-af70-dc9473f08ead tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1087 microversion: 2.1 time: 0.086174 May 09 18:48:17.306708 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 507/1038] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:17 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:18.332590 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-33f2aca3-2879-45e3-9819-bafd6bdc885c tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:18.333617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-33f2aca3-2879-45e3-9819-bafd6bdc885c tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:18.399370 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-33f2aca3-2879-45e3-9819-bafd6bdc885c tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:18.406125 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-33f2aca3-2879-45e3-9819-bafd6bdc885c tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1087 microversion: 2.1 time: 0.080197 May 09 18:48:18.406686 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 532/1039] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:18 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:19.427046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:19.428046 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:19.436294 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:19.436743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:19.437519 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:19.437958 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:19.504466 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:19.512619 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-62644e6a-8d61-41e1-8499-c73df9ebd8ca tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1137 microversion: 2.1 time: 0.092270 May 09 18:48:19.513196 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 508/1040] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:19 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:20.534533 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:20.535183 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:20.542920 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:20.543368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:20.544187 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:20.544782 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:20.609951 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:20.619047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-f337ff7d-f48c-4a16-bb29-23fac7ef4fe3 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1203 microversion: 2.1 time: 0.088727 May 09 18:48:20.619971 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 533/1041] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:20 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:21.637238 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:21.638612 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:21.647801 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:21.648646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:21.654055 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:21.654554 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:21.658513 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-c3ee1de3-8f42-4545-bbb3-96bfcdafa297 req-97fed7e3-5113-4aa4-897d-76355e9a2de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:48:21.667156 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c3ee1de3-8f42-4545-bbb3-96bfcdafa297 req-97fed7e3-5113-4aa4-897d-76355e9a2de1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:21.667975 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-c3ee1de3-8f42-4545-bbb3-96bfcdafa297 req-97fed7e3-5113-4aa4-897d-76355e9a2de1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:21.680341 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-c3ee1de3-8f42-4545-bbb3-96bfcdafa297 req-97fed7e3-5113-4aa4-897d-76355e9a2de1 service nova] Creating event network-changed:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:48:21.685895 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-c3ee1de3-8f42-4545-bbb3-96bfcdafa297 req-97fed7e3-5113-4aa4-897d-76355e9a2de1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108882 May 09 18:48:21.687116 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 509/1042] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:48:21.807434 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:21.814922 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-05a98e0c-1e76-4a3f-a50f-02995f85906f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.181837 May 09 18:48:21.815552 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 534/1043] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:21 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:48:22.838431 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:22.839216 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:22.846914 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:22.847409 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:22.848302 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:22.848783 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:22.992646 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:23.004713 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-0d45b220-4433-40bb-902f-ef51aa9f5b1b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.174006 May 09 18:48:23.005272 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 510/1044] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:22 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:24.025843 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:24.026577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:24.034946 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:24.035510 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:24.036522 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:24.037078 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:24.182046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:24.189855 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0f3f7442-be56-4413-a4b4-c04561b0aaf4 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.169106 May 09 18:48:24.190449 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 535/1045] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:24 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:25.211051 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:25.212045 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:25.222803 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:25.223559 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:25.224879 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:25.225627 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:25.359741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:25.367256 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-42293d91-587d-4f04-8b33-bab0754257c0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.162914 May 09 18:48:25.367822 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 511/1046] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:25 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:26.388300 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:26.389275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:26.399749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:26.400582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:26.401375 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:26.401809 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:26.535218 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:26.543275 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-1e8fa434-5a32-46ab-9d07-eca6453aafae tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.161716 May 09 18:48:26.543859 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 536/1047] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:26 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:27.564738 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:27.565803 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:27.575213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:27.575705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:27.576523 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:27.576969 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:27.718650 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:27.726871 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a724f578-de86-4281-880a-91af2481b68f tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.168852 May 09 18:48:27.727496 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 512/1048] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:27 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:28.748905 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:28.750209 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:28.761290 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:28.762046 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:28.763350 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:28.764118 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:28.902839 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:28.910614 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-ae8326cf-d868-46e8-a7a2-07e820ef78eb tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.168823 May 09 18:48:28.911211 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 537/1049] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:28 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:29.930834 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:29.931844 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:29.942595 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:29.943344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:29.944677 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:29.945402 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:30.089963 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:30.098213 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-2b827530-eba7-464d-a0f7-2d16c2e8cd65 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.173950 May 09 18:48:30.098778 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 513/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:29 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:31.122015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:31.122745 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:31.131240 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:31.131768 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:31.132692 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:31.133195 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:31.265719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:31.273212 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6b38b56e-eb60-44f1-a99b-c99aa578fb1a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.155755 May 09 18:48:31.273777 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 538/1051] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:31 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:32.290054 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:32.290673 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:32.297419 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:32.297868 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:32.298644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:32.299075 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:32.433058 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:32.436637 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-a54b88ee-d1e8-40cd-a882-f788ec914512 req-31894703-4eff-4a98-b66a-cc97cffc9d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "name": "network-vif-plugged", "status": "completed", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:48:32.446898 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-a28e8679-0974-452a-bacd-68e6bbe994b9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.160649 May 09 18:48:32.447644 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 514/1052] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:32 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:32.458929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a54b88ee-d1e8-40cd-a882-f788ec914512 req-31894703-4eff-4a98-b66a-cc97cffc9d89 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:32.459392 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-a54b88ee-d1e8-40cd-a882-f788ec914512 req-31894703-4eff-4a98-b66a-cc97cffc9d89 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:32.470666 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-a54b88ee-d1e8-40cd-a882-f788ec914512 req-31894703-4eff-4a98-b66a-cc97cffc9d89 service nova] Creating event network-vif-plugged:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:48:32.475719 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-a54b88ee-d1e8-40cd-a882-f788ec914512 req-31894703-4eff-4a98-b66a-cc97cffc9d89 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106471 May 09 18:48:32.476348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 539/1053] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:48:33.468952 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:33.469950 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:33.480343 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:33.481462 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:33.482261 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:33.482699 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:33.620785 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:33.628870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-e7c7e331-8be6-4078-9761-20b651dabb52 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1259 microversion: 2.1 time: 0.166625 May 09 18:48:33.629439 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 515/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:33 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:34.651575 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:34.652765 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:34.659754 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:34.660237 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:34.661040 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:34.661477 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:34.793468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:34.801229 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-96ce76e9-5f56-4d88-929d-6d36892f4fb0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1443 microversion: 2.1 time: 0.157518 May 09 18:48:34.801804 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 540/1055] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:34 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:34.817643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:48:34.818263 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:48:34.825106 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:34.825561 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:34.826341 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:34.826776 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:34.978941 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:48:34.987478 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-33c68fe8-ec6d-44a7-9f50-d83028768c3a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1443 microversion: 2.1 time: 0.173687 May 09 18:48:34.988109 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 516/1056] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:48:34 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:48:36.712377 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [req-2083db04-6036-49cc-a27e-d12b155064ec req-58f71f06-5a93-4a09-8480-22c2e6455356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:48:36.720688 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2083db04-6036-49cc-a27e-d12b155064ec req-58f71f06-5a93-4a09-8480-22c2e6455356 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:48:36.721128 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [req-2083db04-6036-49cc-a27e-d12b155064ec req-58f71f06-5a93-4a09-8480-22c2e6455356 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:48:36.731711 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.compute.server_external_events [req-2083db04-6036-49cc-a27e-d12b155064ec req-58f71f06-5a93-4a09-8480-22c2e6455356 service nova] Creating event network-changed:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:48:36.738510 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [req-2083db04-6036-49cc-a27e-d12b155064ec req-58f71f06-5a93-4a09-8480-22c2e6455356 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029807 May 09 18:48:36.739092 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 541/1057] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:50:31.366875 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f8e8d01-a87d-4fa7-ae94-8cc9283277c3] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 09 18:50:31.373278 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:50:31.374152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:31.384555 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:31.385346 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:31.386601 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:31.387363 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:31.410518 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.objects.instance [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lazy-loading 'flavor' on Instance uuid 62121286-4adf-4eaa-95a3-d7fffd193d58 {{(pid=118350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:50:31.488743 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-149f6263-16a1-4ac5-8cb2-4b731b6ca997 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "POST /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58/action" status: 202 len: 0 microversion: 2.1 time: 0.124990 May 09 18:50:31.489335 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 517/1058] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:50:31 2022] POST /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:50:31.495996 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e015298-29ed-4ee8-b9d3-f639c96aacf0] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 18:50:31.500202 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:31.501041 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:31.507753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:31.508285 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:31.509221 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:31.509659 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:31.660437 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:31.671789 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7ae041fc-4f91-41ba-8bb7-e78d9bd37022 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.177428 May 09 18:50:31.672544 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 542/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:31 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:32.697359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:32.698155 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:32.707210 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:32.707835 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:32.709025 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:32.709600 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:32.716620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f8e8d01-a87d-4fa7-ae94-8cc9283277c3] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 34810. May 09 18:50:32.854056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:32.863384 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-9d7196c3-dc6b-4c68-87d0-20ecadb7afcf tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.173855 May 09 18:50:32.863968 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 518/1060] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:32 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:33.883348 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:33.884026 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:33.894567 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:33.895010 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:33.895788 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:33.896249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:33.914582 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e015298-29ed-4ee8-b9d3-f639c96aacf0] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 34814. May 09 18:50:34.034753 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:34.043246 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-a5466907-902d-473f-8e87-a491618e60e8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.165681 May 09 18:50:34.043791 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 543/1061] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:33 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:35.070120 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:35.071132 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:35.079816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:35.080296 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:35.081060 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:35.081487 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:35.228546 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:35.237642 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-adf85d65-f703-4324-8a3c-feb65726ad82 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.174343 May 09 18:50:35.238215 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 519/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:35 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:36.263272 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:36.264058 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:36.273987 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:36.274683 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:36.275892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:36.276608 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:36.578250 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:36.586273 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-09c59cd2-2db3-4523-814f-d150a557ed13 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.328624 May 09 18:50:36.586856 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 544/1063] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:36 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:37.608463 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:37.609167 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:37.616451 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:37.616923 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:37.617855 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:37.618315 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:37.757620 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:37.769332 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-562d1d94-3b96-4c8c-b280-962b4792e675 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.167645 May 09 18:50:37.770203 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 520/1064] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:37 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:38.791450 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:38.792353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:38.801036 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:38.801484 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:38.802249 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:38.802678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:38.938646 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:38.950124 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-869d4285-96a3-4d10-823d-ecb07559b5da tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.164991 May 09 18:50:38.951089 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 545/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:38 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:39.972310 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:39.973384 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:39.984643 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:39.985411 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:39.986745 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:39.987479 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:40.140128 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:40.152972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-522ec384-1719-426d-a0fd-8446ea1acd58 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.187183 May 09 18:50:40.153935 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 521/1066] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:39 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:41.176540 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:41.180500 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:41.188402 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:41.189139 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:41.190398 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:41.191121 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:41.329733 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:41.338182 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-59502620-e98f-4c7f-be2c-632059c56d12 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.168509 May 09 18:50:41.338749 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 546/1067] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:41 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:42.361066 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:42.361663 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:42.368420 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:42.368897 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:42.369680 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:42.370110 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:42.508658 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:42.516450 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-52e6399f-114b-4b46-9b55-952f59dd56f9 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.159348 May 09 18:50:42.517225 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 522/1068] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:42 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:43.537577 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:43.538509 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:43.548869 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:43.549561 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:43.550478 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:43.550950 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:43.697016 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:43.708407 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-620dd4cd-ea22-4294-8c65-1706d71f74c8 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.176618 May 09 18:50:43.709199 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 547/1069] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:43 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:44.734878 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:44.735761 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:44.746500 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:44.747250 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:44.748596 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:44.749325 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:44.884971 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:44.892444 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-05cb510e-3fcb-4632-944e-55a9d41f6538 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1569 microversion: 2.1 time: 0.164254 May 09 18:50:44.893031 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 523/1070] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:44 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:44.908831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:50:44.909410 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:44.915736 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:44.916227 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:44.917064 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:44.917501 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:45.009132 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-7f9d5e8b-73b9-4fef-a9a8-97f168f72d60 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "POST /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58/action" status: 202 len: 0 microversion: 2.1 time: 0.104036 May 09 18:50:45.009836 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 548/1071] 10.222.0.35 () {60 vars in 1277 bytes} [Mon May 9 18:50:44 2022] POST /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:50:45.017901 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:45.018584 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:45.024758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:45.025218 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:45.026001 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:45.026435 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:45.192611 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:45.200255 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-28a4f253-4474-4178-a504-664d17f78a1e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1517 microversion: 2.1 time: 0.186396 May 09 18:50:45.200790 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 524/1072] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:45 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:46.221479 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:46.222047 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:46.228247 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:46.228640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:46.229418 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:46.229831 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:46.379616 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:46.387426 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-19ec4dc6-eece-4a06-82a5-822f10ee3666 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.171940 May 09 18:50:46.387997 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 549/1073] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:46 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:47.063706 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-05a0b320-679c-4bac-9a9d-e3d9622f7c40 req-0ac78708-a196-4521-a895-891883a27367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "name": "network-vif-unplugged", "status": "completed", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:50:47.073015 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-05a0b320-679c-4bac-9a9d-e3d9622f7c40 req-0ac78708-a196-4521-a895-891883a27367 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:47.073371 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-05a0b320-679c-4bac-9a9d-e3d9622f7c40 req-0ac78708-a196-4521-a895-891883a27367 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:47.085576 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-05a0b320-679c-4bac-9a9d-e3d9622f7c40 req-0ac78708-a196-4521-a895-891883a27367 service nova] Creating event network-vif-unplugged:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:50:47.090748 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-05a0b320-679c-4bac-9a9d-e3d9622f7c40 req-0ac78708-a196-4521-a895-891883a27367 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030903 May 09 18:50:47.091344 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 525/1074] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:50:47.409643 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:47.410353 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:47.418618 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:47.419251 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:47.420266 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:47.421136 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:47.554892 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:47.563617 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-2b4f4a03-81c9-4026-9438-6d2be2d6ec5b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.160385 May 09 18:50:47.564269 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 550/1075] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:47 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:48.582734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:48.583608 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:48.590514 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:48.590972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:48.591758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:48.592222 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:48.733813 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:48.742238 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-19f50844-1830-4bdf-93cb-1f14211f921a tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.164287 May 09 18:50:48.742816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 526/1076] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:48 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:49.768640 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:49.770063 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:49.784264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:49.784728 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:49.785508 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:49.785943 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:49.927586 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:49.935468 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6ebe80a1-3ae1-49a0-9825-ab8a164cd258 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.178607 May 09 18:50:49.936072 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 551/1077] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:49 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:50.956972 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:50.957640 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:50.965088 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:50.965593 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:50.966458 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:50.966943 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:51.103482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:51.111142 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-c471ed1e-9d02-4907-9b3a-5bfd2d245d29 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.160799 May 09 18:50:51.111710 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 527/1078] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:50 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:52.137504 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:52.138690 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:52.149328 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:52.150077 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:52.151403 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:52.152139 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:52.292841 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:52.301400 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-33ba17ba-bb28-4f38-aef3-4dea8b169d86 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.170472 May 09 18:50:52.301969 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 552/1079] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:52 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:53.323437 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:53.324671 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:53.334221 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:53.334672 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:53.335438 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:53.335865 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:53.476734 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:53.484649 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-76addf42-f4ad-475a-bbc7-9e3aba9bf3e0 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1575 microversion: 2.1 time: 0.168217 May 09 18:50:53.485219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 528/1080] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:53 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:54.502141 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:50:54.502668 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:50:54.509698 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:54.510152 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:54.510929 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:54.511360 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:54.645704 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:50:54.653502 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-c4be68a5-9a13-4e1e-bcdd-373865f4bba2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1562 microversion: 2.1 time: 0.155467 May 09 18:50:54.654070 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 553/1081] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:50:54 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:50:57.172225 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-44ba92c5-15b9-4649-8d3e-44a3d4138e32 req-1392cd1a-bcbf-4288-ad37-69e3629afcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "name": "network-vif-plugged", "status": "completed", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:50:57.182909 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-44ba92c5-15b9-4649-8d3e-44a3d4138e32 req-1392cd1a-bcbf-4288-ad37-69e3629afcb8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:50:57.183359 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-44ba92c5-15b9-4649-8d3e-44a3d4138e32 req-1392cd1a-bcbf-4288-ad37-69e3629afcb8 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:50:57.198609 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-44ba92c5-15b9-4649-8d3e-44a3d4138e32 req-1392cd1a-bcbf-4288-ad37-69e3629afcb8 service nova] Creating event network-vif-plugged:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:50:57.205632 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-44ba92c5-15b9-4649-8d3e-44a3d4138e32 req-1392cd1a-bcbf-4288-ad37-69e3629afcb8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037266 May 09 18:50:57.206231 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 529/1082] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:51:34.859041 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:51:34.859758 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:51:49.407667 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:51:49.408674 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:51:53.016015 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:51:53.017069 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:51:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:52:11.425988 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:11.426649 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:52:11.433264 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:11.433795 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:11.434696 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:11.435204 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:11.462457 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Going to try to terminate instance {{(pid=118351) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:52:11.497152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-e9b1e14b-4ca8-4cfa-bf7f-620553926d39 req-b430387c-ed28-45a9-93ac-bb4edb19da7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:52:11.506056 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e9b1e14b-4ca8-4cfa-bf7f-620553926d39 req-b430387c-ed28-45a9-93ac-bb4edb19da7f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:11.506576 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-e9b1e14b-4ca8-4cfa-bf7f-620553926d39 req-b430387c-ed28-45a9-93ac-bb4edb19da7f service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:11.518219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-e9b1e14b-4ca8-4cfa-bf7f-620553926d39 req-b430387c-ed28-45a9-93ac-bb4edb19da7f service nova] Creating event network-changed:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:52:11.523591 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-e9b1e14b-4ca8-4cfa-bf7f-620553926d39 req-b430387c-ed28-45a9-93ac-bb4edb19da7f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099854 May 09 18:52:11.524232 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 530/1083] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:52:11.555678 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-eccee387-f2b4-4fb9-972f-c74b2f496db2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "DELETE /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 204 len: 0 microversion: 2.1 time: 0.134038 May 09 18:52:11.556303 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 554/1084] 10.222.0.35 () {58 vars in 1238 bytes} [Mon May 9 18:52:11 2022] DELETE /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:52:11.568978 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:11.569960 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:52:11.576937 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:11.577488 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:11.578354 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:11.578867 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:11.760152 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.policy [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118350) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:52:11.767858 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-895f1301-fe47-4a56-8dab-1aab4a9e5f4e tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.203531 May 09 18:52:11.768497 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 531/1085] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:52:11 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:52:12.786619 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:12.787367 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:52:12.794257 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:12.794776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:12.795549 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:12.796014 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:12.931776 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:52:12.940162 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-6c8a54c9-6c16-4d62-ab33-dbc3670f7560 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1568 microversion: 2.1 time: 0.157970 May 09 18:52:12.940727 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 555/1086] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:52:12 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:52:13.627378 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [req-1b3b8541-63e4-4823-bffa-bcd8b9bad7a7 req-1f3f07c0-dc09-403e-ad54-3f6d9e823eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62121286-4adf-4eaa-95a3-d7fffd193d58", "name": "network-vif-deleted", "tag": "a973306f-e151-4952-baa9-b6cf95375378"}]} {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:52:13.637816 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-1b3b8541-63e4-4823-bffa-bcd8b9bad7a7 req-1f3f07c0-dc09-403e-ad54-3f6d9e823eb1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:13.638483 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [req-1b3b8541-63e4-4823-bffa-bcd8b9bad7a7 req-1f3f07c0-dc09-403e-ad54-3f6d9e823eb1 service nova] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:13.652670 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.compute.server_external_events [req-1b3b8541-63e4-4823-bffa-bcd8b9bad7a7 req-1f3f07c0-dc09-403e-ad54-3f6d9e823eb1 service nova] Creating event network-vif-deleted:a973306f-e151-4952-baa9-b6cf95375378 for instance 62121286-4adf-4eaa-95a3-d7fffd193d58 on hv-cinder-83588 May 09 18:52:13.658422 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [req-1b3b8541-63e4-4823-bffa-bcd8b9bad7a7 req-1f3f07c0-dc09-403e-ad54-3f6d9e823eb1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 May 09 18:52:13.659026 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 532/1087] 10.222.0.35 () {64 vars in 1317 bytes} [Mon May 9 18:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:52:13.957709 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:13.959141 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.compute.api [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118351) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:52:13.966409 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:13.966937 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:13.967779 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:13.968611 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG oslo_concurrency.lockutils [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:14.036090 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.policy [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ed2c21d3b04aaa8d45c1be4c2f2481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f388007834b3fa50e343bc94b9494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118351) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:52:14.046941 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-0d724392-01b7-4965-aaf8-a050d992eab2 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 200 len: 1218 microversion: 2.1 time: 0.093307 May 09 18:52:14.047521 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 556/1088] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:52:13 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:52:15.069482 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '>' {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:15.070631 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.compute.api [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] [instance: 62121286-4adf-4eaa-95a3-d7fffd193d58] Fetching instance by UUID {{(pid=118350) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:52:15.079741 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:15.080219 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:15.080984 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:52:15.081417 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG oslo_concurrency.lockutils [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Lock "6f91d991-cb29-42d8-aa28-79062e35eafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:52:15.095160 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.wsgi [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] HTTP exception thrown: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Request method failure captured: May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: request: GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 HTTP/1.1 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept: application/json May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Accept-Encoding: identity May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Connection: close May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Length: 0 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Content-Type: application/json May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Host: 10.222.0.35 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Openstack-System-Scope: None May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: User-Agent: python-urllib3/1.26.9 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Auth-Token: gAAAAABieWHYlGiIYixKCv1lH_VaG43PHJe9OFHKczTsW_A49BTLp7HAsga3GWzUSa6d_qBn7AjWcFTC8IlWPHHpXrSzFzxC4hAqTjJKRuLLlPsOeQPMzmtrgnLOaAGREP2182FJHgg9OhPi6-pE8gS6XN1Yfr3P97Fhf2THnYNPcbdzYS1l4DE May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Id: None May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Domain-Name: None May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Identity-Status: Confirmed May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Is-Admin-Project: True May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Id: default May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Domain-Name: Default May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Id: 2b3f388007834b3fa50e343bc94b9494 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Project-Name: tempest-TestShelveInstance-1880977209 May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Role: member,reader May 09 18:52:15.096863 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Roles: member,reader May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b3f388007834b3fa50e343bc94b9494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b3f388007834b3fa50e343bc94b9494"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b3f388007834b3fa50e343bc94b9494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b3f388007834b3fa50e343bc94b9494"}]}] May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant: tempest-TestShelveInstance-1880977209 May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Id: 2b3f388007834b3fa50e343bc94b9494 May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-Tenant-Name: tempest-TestShelveInstance-1880977209 May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User: tempest-TestShelveInstance-1880977209-project May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Id: default May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Domain-Name: Default May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Id: c2ed2c21d3b04aaa8d45c1be4c2f2481 May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: X-User-Name: tempest-TestShelveInstance-1880977209-project May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: method: > May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: exception: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. May 09 18:52:15.098698 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: action_args: {'id': '62121286-4adf-4eaa-95a3-d7fffd193d58'} May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: {{(pid=118350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:52:15.099705 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. May 09 18:52:15.101423 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: ERROR nova.api.openstack.wsgi May 09 18:52:15.102870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: DEBUG nova.api.openstack.wsgi [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Returning 404 to user: Instance 62121286-4adf-4eaa-95a3-d7fffd193d58 could not be found. {{(pid=118350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:52:15.102870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO nova.api.openstack.requestlog [None req-5caf94e6-4d14-4e42-ab5a-fe18594f7215 tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58" status: 404 len: 111 microversion: 2.1 time: 0.037178 May 09 18:52:15.102870 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: [pid: 118350|app: 0|req: 533/1089] 10.222.0.35 () {58 vars in 1235 bytes} [Mon May 9 18:52:15 2022] GET /compute/v2.1/servers/62121286-4adf-4eaa-95a3-d7fffd193d58 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:52:15.268862 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: DEBUG nova.api.openstack.wsgi [None req-8daa00f2-22b4-4c63-af0d-390e85af393b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] Calling method '.version_select at 0x7fe8c3ddf940>' {{(pid=118351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:52:15.292462 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO nova.api.openstack.requestlog [None req-8daa00f2-22b4-4c63-af0d-390e85af393b tempest-TestShelveInstance-1880977209 tempest-TestShelveInstance-1880977209-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-43871121" status: 202 len: 0 microversion: 2.1 time: 0.027413 May 09 18:52:15.293425 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: [pid: 118351|app: 0|req: 557/1090] 10.222.0.35 () {58 vars in 1247 bytes} [Mon May 9 18:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-43871121 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:53:16.985317 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:53:16.986139 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:54:54.870042 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:54:54.871174 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:55:09.421802 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:55:09.422823 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:55:13.029368 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:55:13.030415 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:55:28.285337 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:55:28.286092 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:56:36.995305 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:56:36.996445 dv-cinder-835881-8-iscsi devstack@n-api.service[118350]: Mon May 9 18:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:56:43.541865 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:56:43.542390 dv-cinder-835881-8-iscsi devstack@n-api.service[118351]: Mon May 9 18:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!